The Design and Organization of Data Centers/Electrical

Types of Service edit

  • 120 V 1 phase
    • Hot, Neutral, Ground
  • 240 V 1 phase
    • 2 Hots, 1 Ground
  • 208 V 3 phase
    • 3 Hots, 1 Neutral, 1 Ground
  • 208 V 1 phase
    • 2 Hots, 1 Ground
  • 480 V 3 phase
    • 3 Hots, 1 Neutral, 1 Ground
  • 48 V DC
    • Positive & Negative

Uninteruptable Power Supplies edit

Absolutely necessary

Types edit

Central UPS edit

All equipment stays up for same length of time.

Rack-mounted UPS edit

Put batteries where they are needed most. Easy redundancy with dual power supply computers.

Server-mounted battery edit

Google servers are connected directly to the AC feed with no UPS in the middle. Instead, each server has its own 12 VDC battery, which is used to power the server during power outages.[1][2]

Brick UPS edit

Good for smaller installations. Easy redundancy with dual power supply computers.

Sizing edit

Loads that cannot tolerate any outage shall be placed on UPS power. Critical systems, such as the air conditioning cannot tolerate a brief outage, so they should be supported from generator power. Battery run time for UPS loads are dependent upon the budget and level of reliability required. With a well designed backup generation system, UPS runtime may be minimized since the gensets will be online in 8 to 20 seconds.

Power Interruption edit

Plan for unattended shutdown and restart whenever possible.

Consider remote alert of power interruption.

Make sure the KVM is also on UPS.

Make sure you have emergency lights and flashlights for working in the dark.

Estimating remaining run time

Restart of UPS after full drain

Redundant UPS systems edit

Rack-mounted - side to side redundancy.

Central UPS - need two of them with separate breaker boxes/PDUs and color coded system.

Generators edit

Determine your local outage characteristics for your power supplier. Do they tend to be infrequent, but long? Common, but short?

On-site vs delivery contract

On site minimizes need for large UPSes

Environmental issues and permit requirements for fuel storage

Layout and Redundancy edit

Look for computers with dual power supplies, or, less preferably, make sure you have redundant boxes per function. This allows for rearranging power cables and moving a box from one area to another without turning it off.

Maintain side-to-side redundancy by placing power strips on separate breakers or UPSes.

Remote Power Control edit

Remote power on and off

Resetting stuck machines and routers

Power on sequencing

Electrical Grounding/Earthing edit

All metal server or network racks and cabinets, overhead raceways and metallic conduit must be properly grounded to each other and to ground.

  1. "Google Unveils Custom Server/UPS/Power Supply" by Joe Polastre, April 1, 2009
  2. Slashdot: "Google Reveals "Secret" Server Designs" April 02, 2009