Page 1 of 2 12 LastLast
Results 1 to 15 of 24
  1. #1
    Addict
    Points: 119,458, Level: 100
    Level completed: 0%, Points required for next Level: 0
    Overall activity: 3.0%
    Achievements:
    SocialVeteran50000 Experience Points
    jsmith86's Avatar
    Join Date
    Dec 2006
    Location
    Tulsa
    Posts
    6,193
    Points
    119,458
    Level
    100
    Thumbs Up
    Received: 0
    Given: 0

    Building the fastest computer(s) I can buy for 50-100K. What should I get?

    Thought this would be a nice break from all the realignment stuff. So my advisor came to me recently and tells me to price out some new computer stuff because we (our research group) got some money for it. Anything less than $50,000 will probably be accepted right away. Up to $150,000 is still probably good as well. So what should I get? I need something to run CFD simulations as fast as possible, so the more cores and RAM the better. Infiniband/Myrinet or similar for interconnect. What should I get? Specific vendors I should call for a quote? Or would I be better getting an infiniband switch and cards to connect my 4 existing workstations?


    ____________________________________

    You can't die. That would upset the equilibrium in the Cave.
    Warning: Posts contain 98% post-sarcastic content.
    Hoiball

  2. #2
    Addict
    Points: 94,094, Level: 95
    Level completed: 50%, Points required for next Level: 956
    Overall activity: 7.0%
    Achievements:
    Veteran50000 Experience Points
    xboxfever's Avatar
    Join Date
    Nov 2008
    Posts
    5,929
    Points
    94,094
    Level
    95
    Thumbs Up
    Received: 110
    Given: 180

    Re: Building the fastest computer(s) I can buy for 50-100K. What should I get?



    Whoever made this sign, can't spell getting however.



  3. #3
    Legend
    Points: 275,834, Level: 100
    Level completed: 0%, Points required for next Level: 0
    Overall activity: 2.0%
    Achievements:
    Social50000 Experience PointsVeteran
    VeloClone's Avatar
    Join Date
    Jan 2010
    Location
    Brooklyn Park, MN
    Posts
    12,931
    Points
    275,834
    Level
    100
    Thumbs Up
    Received: 480
    Given: 928

    Re: Building the fastest computer(s) I can buy for 50-100K. What should I get?

    Commodore 64.


    "There are five real good recruits in the state. We got three of them. One couldn’t get into school, and the other went to (the University of) Iowa...which is about the same thing." - Coach Johnny Orr

  4. #4
    Speechless
    Points: 857,268, Level: 100
    Level completed: 0%, Points required for next Level: 0
    Overall activity: 50.0%
    Achievements:
    SocialVeteranCreated Album pictures50000 Experience PointsOverdrive
    CycloneErik's Avatar
    Join Date
    Jan 2008
    Location
    Jamerica
    Posts
    55,072
    Points
    857,268
    Level
    100
    Thumbs Up
    Received: 1,297
    Given: 1,127

    Re: Building the fastest computer(s) I can buy for 50-100K. What should I get?

    Buy a calculator. They'll never know the difference.


    Since we are an elite team now, let's go get that One Cyclone Moment.
    Make this one for the ages!




    http://rememberingdoria.wordpress.com/

  5. #5
    All-Star
    Points: 34,026, Level: 56
    Level completed: 82%, Points required for next Level: 224
    Overall activity: 16.0%
    Achievements:
    Veteran25000 Experience Points
    ShopTalk's Avatar
    Join Date
    Dec 2008
    Location
    Houston, TX
    Posts
    1,504
    Points
    34,026
    Level
    56
    Thumbs Up
    Received: 13
    Given: 30

    Re: Building the fastest computer(s) I can buy for 50-100K. What should I get?

    Here's how they do it at the highest levels:

    1) Buy the cheapest piece of crap desktop you can find from Dell.
    2) Take the rest of the money and blow it on whatever floats your boat.
    3) Make **** up. The more insane and clearly so, the better. Just make sure whoever is paying for this has already told you what your outcome will be.

    Anytime you're running simulations on anything that has 3 letters, it is bull ****.



  6. #6
    Pro
    Points: 72,425, Level: 83
    Level completed: 58%, Points required for next Level: 725
    Overall activity: 0%
    Achievements:
    50000 Experience PointsVeteran
    SvrWxCy's Avatar
    Join Date
    Aug 2010
    Location
    Kansas
    Posts
    2,851
    Points
    72,425
    Level
    83
    Thumbs Up
    Received: 0
    Given: 0

    Re: Building the fastest computer(s) I can buy for 50-100K. What should I get?

    I'm guessing you would want to do a cluster of desktops so you can make use of multiple computers at once...


    Last edited by SvrWxCy; 09-15-2011 at 07:13 PM.

  7. #7
    Speechless
    Points: 450,835, Level: 100
    Level completed: 0%, Points required for next Level: 0
    Overall activity: 10.0%
    Achievements:
    SocialRecommendation Second ClassVeteran50000 Experience PointsOverdrive
    brianhos's Avatar
    Join Date
    Jun 2006
    Location
    Trenchtown
    Posts
    39,586
    Points
    450,835
    Level
    100
    Thumbs Up
    Received: 177
    Given: 27

    Re: Building the fastest computer(s) I can buy for 50-100K. What should I get?

    Dell 910s with 10G Ethernet. You can get 32 cores per box and up to 512Gb of ram.


    They who can give up essential liberty to obtain a little temporary safety, deserve neither liberty nor safety. - Benjamin Franklin 1775

  8. #8
    All-Star
    Points: 38,006, Level: 60
    Level completed: 13%, Points required for next Level: 1,044
    Overall activity: 0%
    Achievements:
    Veteran25000 Experience Points
    ISU_phoria's Avatar
    Join Date
    Apr 2006
    Location
    Andover, MN
    Posts
    1,867
    Points
    38,006
    Level
    60
    Thumbs Up
    Received: 9
    Given: 1

    Re: Building the fastest computer(s) I can buy for 50-100K. What should I get?

    No idea on cost, but a client of mine is Cray. They make the fastest computers in the world.....most of their stuff is sold to the US Government. They're located in Chippewa Falls, WI. I don't know if you can even touch their stuff for a $100K, but if you want me to send you contact information, let me know.



  9. #9
    All-Star
    Points: 23,197, Level: 46
    Level completed: 65%, Points required for next Level: 353
    Overall activity: 1.0%
    Achievements:
    SocialVeteran10000 Experience Points
    cloneluke80's Avatar
    Join Date
    Apr 2006
    Location
    West Des Moines, IA
    Posts
    1,611
    Points
    23,197
    Level
    46
    Thumbs Up
    Received: 5
    Given: 2

    Re: Building the fastest computer(s) I can buy for 50-100K. What should I get?

    Get a cluster, cluster them out with RHEL 6.X, its cluster suite and GFS2, you can do infiniband interconnects and a small SAN, you can prob get all of this done for $60 - $80k and have some serious horsepower and failover capabilities. That's what I would do.



  10. #10
    Speechless
    Points: 450,835, Level: 100
    Level completed: 0%, Points required for next Level: 0
    Overall activity: 10.0%
    Achievements:
    SocialRecommendation Second ClassVeteran50000 Experience PointsOverdrive
    brianhos's Avatar
    Join Date
    Jun 2006
    Location
    Trenchtown
    Posts
    39,586
    Points
    450,835
    Level
    100
    Thumbs Up
    Received: 177
    Given: 27

    Re: Building the fastest computer(s) I can buy for 50-100K. What should I get?

    Quote Originally Posted by ISU_phoria View Post
    No idea on cost, but a client of mine is Cray. They make the fastest computers in the world.....most of their stuff is sold to the US Government. They're located in Chippewa Falls, WI. I don't know if you can even touch their stuff for a $100K, but if you want me to send you contact information, let me know.
    No you cannot even talk to Cray for less than a million.


    They who can give up essential liberty to obtain a little temporary safety, deserve neither liberty nor safety. - Benjamin Franklin 1775

  11. #11
    Pro
    Points: 150,384, Level: 100
    Level completed: 0%, Points required for next Level: 0
    Overall activity: 8.0%
    Achievements:
    Social50000 Experience PointsVeteran
    iahawkhunter's Avatar
    Join Date
    Apr 2010
    Location
    Grimes, IA
    Posts
    2,758
    Points
    150,384
    Level
    100
    Thumbs Up
    Received: 6
    Given: 11

    Re: Building the fastest computer(s) I can buy for 50-100K. What should I get?

    Can your CFD codes take advantage of GPGPUs? If so, I'd consider making a handful of "desktop supercomputers", as NVIDIA calls them, with multiple GPGPUs per machine and then link the workstations together as a cluster. Basically a hybrid of MPI (for communication between computers) and CUDA (for the GPGPUs themselves). The Asteroid Deflection Research Group at ISU has taken this approach with some of their recent work and had great success. If you're clever with the code (assuming you have that kind of access) you may be able to make use of the existing workstations as well, but that could be an extra headache. Out of curiosity, are you using commercial packages or custom code?

    I'm not up on the details of Infiniband/Myrinet, but I would suggest trying to evaluate the bandwidth you actually need rather than simply going for a specific product. My cluster computing focuses on CT reconstructions so I spend a heck of a lot more time doing calculations on each node as compared to transferring data (we have gigabit ethernet on the CNDE cluster), so a faster interconnect doesn't gain me much. These reconstructions are also "embarrassingly parallel", so I don't need any inter-node communications during the reconstruction process. From the (very) little CFD work I've done I could easily imagine that you'll need more inter-node communication than I do.

    I believe that the CFD center at ISU has done some work with using GPGPUs, so they may be able to answer some questions. The director is Dr. ZJ Wang.


    Quote Originally Posted by im4cyclones View Post
    [Anything] is easy if you are content to suck at it.

  12. #12
    Addict
    Points: 214,219, Level: 100
    Level completed: 0%, Points required for next Level: 0
    Overall activity: 0%
    Achievements:
    Veteran50000 Experience Points
    JUKEBOX's Avatar
    Join Date
    Oct 2008
    Posts
    7,029
    Points
    214,219
    Level
    100
    Thumbs Up
    Received: 47
    Given: 0

    Re: Building the fastest computer(s) I can buy for 50-100K. What should I get?

    Quote Originally Posted by jsmith86 View Post
    Thought this would be a nice break from all the realignment stuff. So my advisor came to me recently and tells me to price out some new computer stuff because we (our research group) got some money for it. Anything less than $50,000 will probably be accepted right away. Up to $150,000 is still probably good as well. So what should I get? I need something to run CFD simulations as fast as possible, so the more cores and RAM the better. Infiniband/Myrinet or similar for interconnect. What should I get? Specific vendors I should call for a quote? Or would I be better getting an infiniband switch and cards to connect my 4 existing workstations?
    Get something that will eat Old Dominion on capitalonebowl.com.



  13. #13
    Hall-Of-Famer
    Points: 93,586, Level: 95
    Level completed: 23%, Points required for next Level: 1,464
    Overall activity: 0%
    Achievements:
    50000 Experience PointsSocialVeteran

    Join Date
    Aug 2010
    Location
    West Des Moines
    Posts
    3,954
    Points
    93,586
    Level
    95
    Thumbs Up
    Received: 0
    Given: 0

    Re: Building the fastest computer(s) I can buy for 50-100K. What should I get?

    I'd go with a gateway...



  14. #14
    Pro
    Points: 55,625, Level: 73
    Level completed: 5%, Points required for next Level: 1,425
    Overall activity: 5.0%
    Achievements:
    VeteranCreated Album pictures50000 Experience Points
    uro cy's Avatar
    Join Date
    Oct 2006
    Posts
    3,334
    Points
    55,625
    Level
    73
    Thumbs Up
    Received: 66
    Given: 48

    Re: Building the fastest computer(s) I can buy for 50-100K. What should I get?

    Quote Originally Posted by CycloneErik View Post
    Buy a calculator. They'll never know the difference.
    No, no, no. Buy a calculator and pocket the difference.



  15. #15
    Addict
    Points: 119,458, Level: 100
    Level completed: 0%, Points required for next Level: 0
    Overall activity: 3.0%
    Achievements:
    SocialVeteran50000 Experience Points
    jsmith86's Avatar
    Join Date
    Dec 2006
    Location
    Tulsa
    Posts
    6,193
    Points
    119,458
    Level
    100
    Thumbs Up
    Received: 0
    Given: 0

    Re: Building the fastest computer(s) I can buy for 50-100K. What should I get?

    Quote Originally Posted by iahawkhunter View Post
    Can your CFD codes take advantage of GPGPUs? If so, I'd consider making a handful of "desktop supercomputers", as NVIDIA calls them, with multiple GPGPUs per machine and then link the workstations together as a cluster. Basically a hybrid of MPI (for communication between computers) and CUDA (for the GPGPUs themselves). The Asteroid Deflection Research Group at ISU has taken this approach with some of their recent work and had great success. If you're clever with the code (assuming you have that kind of access) you may be able to make use of the existing workstations as well, but that could be an extra headache. Out of curiosity, are you using commercial packages or custom code?

    I'm not up on the details of Infiniband/Myrinet, but I would suggest trying to evaluate the bandwidth you actually need rather than simply going for a specific product. My cluster computing focuses on CT reconstructions so I spend a heck of a lot more time doing calculations on each node as compared to transferring data (we have gigabit ethernet on the CNDE cluster), so a faster interconnect doesn't gain me much. These reconstructions are also "embarrassingly parallel", so I don't need any inter-node communications during the reconstruction process. From the (very) little CFD work I've done I could easily imagine that you'll need more inter-node communication than I do.

    I believe that the CFD center at ISU has done some work with using GPGPUs, so they may be able to answer some questions. The director is Dr. ZJ Wang.

    Fluent 6.3 for this set of runs, so no GPU work, although I might make the jump to Fluent 13 next year (or 14 if it is out by then), which hopefully will have GPU support. The problem with GPU computing is that a lot of the time, the software has to be completely rewritten to take advantage of it, and although the methods I use would probably work really well on a GPU, I've written enough custom code as add-ons to fluent as it is, writing a solver would just be a distraction from my real work. Most of my stuff is on columns, but is multiphase, which really adds to the compute time. They are pretty easy to parallelize, but there is a lot of communication between nodes. Right now I have 3 workstations with a total of 26 cores, each workstation working on a different run. Because the lab that we moved to a couple months ago used to be experimental, it only has a 100Mbit switch. I tested out using that thing for communication between computers and it was worse than pulling teeth without anesthetic.


    Right now, it looks like our best option is to go with a system from dell,ibm, or one of the other small cluster providers on the market, depending on which vendor our IT department tells us they will provide the most support for.


    ____________________________________

    You can't die. That would upset the equilibrium in the Cave.
    Warning: Posts contain 98% post-sarcastic content.
    Hoiball

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
  • Football
  • Iowa State vs. North Dakota State
  • August 30, 2014
  • 11:00 AM