0:00
17:53
17:53

This Ridiculous $200 AI GPU Shouldn’t Be This Good

Tech

Go to https://www.piavpn.com/HardwareHaven to get 83% off from our sponsor Private Internet Access with 4 months free! ► Want to support the channel and unlock some perks in the process? Become a RAID member on Patreon or YouTube! 🔓 Patreon: https://www.patreon.com/hardwarehaven 🔓 YouTube: https://www.youtube.com/channel/UCgdTVe88YVSrOZ9qKumhULQ/join ► Checkout items I used (includes affiliate links from which I may receive compensation): 🛍️ V100 SXM2 16G: https://ebay.us/Czmgxx 🛍️ SXM2 PCIe Adapter (Amazon): https://amzn.to/3PgPOWu 🛍️ Cheaper SXM2 Adapters on Ebay: https://ebay.us/3GoalM 🛍️ 80mm Noctua Fan: https://amzn.to/3PaOcxz 🛍️ Motherboard used for testing: https://amzn.to/4ndEBTd ►Here's the fan shroud model, but seriously, it's not very good: https://www.printables.com/model/1707084-80mm-fan-shroud-for-nvidia-v100-sxm2 🎥 Curious About the equipment I use to make my videos? Click Here ► https://hardwarehaven.media/gear --------------------------------------------------- Music (in order): "Hardware Haven Theme" -Me (https://youtu.be/FwD2mOYDPNA) "CRENSHAW VIBES" - GARRISON (https://soundcloud.com/garrison-brown) "Sunshower" - LATASHÁ(https://soundcloud.com/best-music-pro...) "If You Want To" - Me --------------------------------------------------- Timestamps: 0:00 This is the strangest GPU you've ever seen 0:56 What is SXM? 2:35 PCIe Adapter 3:15 Nvidia V100 4:17 Building my GPU 4:48 Private Internet Access (sponsor) 5:49 Test system and booting it up 6:23 Cooling solution 8:11 Total cost breakdown 9:08 Trying out Ollama 10:11 RTX 3060 12G Comparison 10:57 My rudimentary benchmark results 13:12 Trying out Frigate NVR 15:06 Future plans with this GPU 15:40 Some other SXM adapters 16:28 Trying to stay positive

ADVERTISEMENT

Comments 100

Sign in to join the conversation

Sign in
R
robinhollow77 1 month ago

After this video, that product price will increase for sure.

howardandrews312
howardandrews312 1 month ago

I looked into this 1-2 yrs ago, I love that you got it to work!!! What I found most interesting in my findings was that we seem to return to the 60s-80s logic of proprietary mainboards... ATX based servers were kind of a lucky accident probably...

M
martinemarion431 1 month ago

I have two 3090's that I got before everyone went nuts. I can do everything I need on them. I have 16gb 4000 and 5000 series cards for gaming. If you don't want to go crazy and don't feel like tinkering with this setup which I checked ebay the greedy horders have jacked up the prices to where it is better to just get a 3090 used and have someone who knows what they are doing repaste it for you and undervolt them and use them for AI. Otherwise, just don't bother with AI> It is not worth it with these crazy prices.

helena_novais
helena_novais 1 month, 1 week ago

Yes, I've been waiting for somebody to make a video on the V 100. Now I can unload on eBay.

H
hortensepoirier453 1 month, 1 week ago

The V100 is NOT available for $100 ANYWHERE, unless you steal one.

revadawn74
revadawn74 1 month, 1 week ago

Thanks for the lovely insight

K
karen_larson 1 month, 1 week ago

props for running Noctua's.

J
james_west 1 month, 1 week ago

Super informative video! Seems like a legitimately useful avenue for a lot of people

R
ross.woodward 1 month, 2 weeks ago

Bummer you can't give a separate like just for the dog)

nicholas_marsh
nicholas_marsh 1 month, 2 weeks ago

That sxm connector reminds of the socket that Powermac G5 PowerPC cpu sockets used. I remember that some laptops and older Apple iMacs used a slot called MXM, where u could replace the gpu.

caitlin_macdonald
caitlin_macdonald 1 month, 2 weeks ago

Yeah the prices are through the roof now. I don’t see any visible options

E
enzogabriel_pacheco 1 month, 2 weeks ago

For the clickbaint: The newer card that the Nvidia V100 (SXM2 variant on a PCIe adapter) outperformed in the transcript is the Nvidia RTX 3060 (12GB version). - he used the V100 16 GB version

C
cynthia.horn 1 month, 2 weeks ago

it's crazy to me that these GPUs are profitable when they are so expensive and become obsolete so quickly

C
colleen_woodard 1 month, 2 weeks ago

I don't know if you are editing these yourself or if you have an editor but I just love the videography and style of your videos. The shots are simple and visually pleasing.

G
garytaylor19 1 month, 2 weeks ago

In school one day, i was browsing an online marketplace for a bigger rack to put all of my servers (basicly e-waste😅). A friend of my looked and asked "Why do you spend so much money on computer parts and you dont even game?". Every cell in my body cried.

micheal_santiago
micheal_santiago 1 month, 2 weeks ago

well ... this is it for the V100, now everybody knows about it... thank you very much

A
amanda.knight 1 month, 2 weeks ago

15:30 A great option is the Quandro M6000 24GB, under three hundred used.

V
victoire_chrétien 1 month, 2 weeks ago

Oh my word. That segue was mint. I tip my hat to you sir! 5:00

anel.valdez
anel.valdez 1 month, 2 weeks ago

So glad I already bought mine last week, now that you’ve made a video they will skyrocket in price 😂😂😂

J
johnaura45 1 month, 2 weeks ago

16:45 not sure how thrilled I would be to run a 3.5-4 slot GPU.