The Community Forums

Interact with an entire community of cPanel & WHM users!
  1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Upcoming project: Creating a cluster setup

Discussion in 'Bind / DNS / Nameserver Issues' started by [Q3], Oct 7, 2006.

  1. [Q3]

    [Q3] Member

    Apr 8, 2003
    Likes Received:
    Trophy Points:
    Hi guys,

    I'm currently having 2000 customers on multiple stand alone servers.
    I was now looking to have a cluster/load balancing setup.

    I would like to know also what do you suggest to have alone on a seperate server (mail or dns, etc).

    As the web server, I was looking at 3 or 4 servers connected to a storage machine (Dell Powervault or something better).

    The budget is not a problem so I'll look at your suggestion and experience.


  2. mr2jzgte

    mr2jzgte Well-Known Member

    Jun 18, 2003
    Likes Received:
    Trophy Points:
    Dell power vault - (read NX1950) limitations - only 4tb of raid5 space - better off to look at a fibre chanel solution

    now i'll probably get flamed for this.. but 2 x win2k3r2x64 servers running mscs and some custom scripting to act as the NAS servers.

    1-2 x cpanel servers (cpanel admin/client use ONLY)
    1-8 webservers - httpd(webmail) & dns ONLY
    1-8 smtp/pop3 servers
    2 mysql servers
    2 x front end load balancers - commerical solution or freebie (ultramonkey /ipvs) or cisco / barracuda(what we use)
    Create NFS mounts on the windows boxes. Use SFU & some custom scripts for user creation. Modify wwwacct a bit to accomodate - check into NIS with SFU

    Install base os's on the other servers
    set up nfs and fstab structure
    buy 2 cpanel licences
    install cpanel x 2 (or x1)
    custom compile apache2.2 for the webservers + modify php source so that mysql connects - connect to the mysql failover IP - rather than localhost use cband instead of bandmin -
    install exim + courier on mail servers. - Use symlinks or scp & cron to copy files
    set up mysql as a failover clusteri.e primary slave with identical config - with data and config stored on nas.. no need for slave/master just a simple heartbeat config and a few scripts.

    Lots of testing, quite a few custom mods to cpanel - lots of chattr +i'ng to stop upcp blowing away configs, some custom vb scripts to pull quotas etc from windows (yes you could use linux, but seriously, clustering in linux, and clustered fs's suck unless you want to pay bulk$$$ for a decent solution

    thats pretty much all you need to know about cpanel clustering.. fill in the blanks for yourself and extpect minimum 4 weeks full time building the system and debugging and making small changes..

    skills required
    perl scripter
    linux admin
    windows skillset
    clustering knowledge
    lots of coffee
    lots of patience
    ip networking skillset

    Have fun :)

    For reference, drbd, gfs. afs, coda all = BS slow...
    I was lucky to get 70mb/s throughput... Windows NFS - I maxed out the dual path nics in the machines - 1500mbs (read: mbs, NOT MBs)

    Also, the above is usless, unless you have a redudant core capable of failing over. In our case, we have 2 x 6500's(hsrp) + 4 x 24 port gb switches with dual path fibre uplinks into the cisco's, the c6500's handle bgp routing to multiple upstream providers.. We can take 2 of the switches and 1 cisco out of service and everything keeps running.
    #2 mr2jzgte, May 3, 2007
    Last edited: May 3, 2007
  3. maxihost3

    maxihost3 Member

    Jun 14, 2006
    Likes Received:
    Trophy Points:
    Hello mr2jzgte,

    I am looking for a clustered solution like yours, could we discuss further about this project ?

    I have added you on MSN and sent you an e-mail.


Share This Page