![\"bitcoins](\"https:\/\/www.cio.com\/wp-content\/uploads\/2026\/02\/11786-0-67733500-1771326139-author_photo_Hari-Subramanian_1754915795.jpg?quality=50&strip=all&w=134\")
\t\t\t<\/p>\n<\/p><\/div>\nBitcoins
\n\t\t\t\tWhy AI\u2019s insatiable demand for power is a constraint that should matter to the enterprise AI strategy.\t\t\t<\/h2>\n<\/p><\/div>\n\n\nFor the last couple of years, enterprises have doubled and tripled down on investments in AI-related initiatives. The board-level leadership at the Global 1000 enterprises has high expectations of the value that can be unleashed through the power of AI in growing the business as well as driving efficiencies. CIO and CAIO organizations have spent a lot of time and energy on addressing constraints such as data availability, governance and change management to enable value realization through AI initiatives. For the most part, enterprises have assumed unconstrained access to AI infrastructure through hyper-scalers. The exponential reduction in token costs has enabled broader adoption of AI use cases within enterprises.<\/p>\n
As generative AI, agentic systems and real-time inference move from pilots into production, CIO\u2019s and enterprise AI leaders would be well advised to be cognizant of another constraint:\u00a0energy availability and its impacts AI cost, scale and risk. Power, cooling and physical infrastructure and have not been commonly discussed within CIO organizations as a potential constraint.<\/p>\n
This article outlines AI\u2019s energy wake-up call and why CIOs should pay attention to the impact of energy on AI while building their longer-term AI strategy.<\/p>\n<\/div>\n
\nAI\u2019s demand for power<\/h2>\n
According to a study by Bain and Company<\/a>, AI Data centers and their commensurate needs for power are growing exponentially and are pushing towards 100 Gigawatts of new power demand in the US by 2030. For reference, the data center power demand in 2025 is about 30 Gigawatts and this represents a 35% CAGR over the next 5 years.<\/p>\nHyper-scalers are investing billions of dollars and are racing to build data centers. Investment in data centers are expected to reach $ 1 trillion within three years, according to a study by Deloitte<\/a>.<\/p>\nHowever, they face several challenges, such as:<\/p>\n<\/div>\n
\n\n- Grid stress.<\/strong> AI data centers can create large, concentrated clusters of 24 by 7 power demand, causing grid stress. Building new transmission lines can take between 7 and 10 years.<\/li>\n
- Sources of power are constrained.<\/strong> Currently, most of the demand is fueled by natural gas. There are significant supply challenges with other traditional sources, such as coal and renewable sources, such as wind and solar. Nuclear capacity has not been developed in the US for several decades, adding to the potential energy shortage.<\/li>\n
- Cooling requirements.<\/strong> Data centers use several cooling techniques, such as liquid cooling, air cooling, etc. The massive cooling requirement poses an enormous stress on water requirements. This also creates contention for water use by citizens in the municipality, agricultural needs, etc. and in some parts of the country have already created a political backlash<\/a>.<\/li>\n
- Regulatory constraints<\/strong>. In some states and municipalities, the permitting process may take a long time with a lot of uncertainties.<\/li>\n
- Equipment shortage.<\/strong> The data centers and their power infrastructure are dependent on several components \u2014 from steel and copper to switchgear and transformers. In many instances, the demand for these goods far exceeds the supply.<\/li>\n
- Talent shortage.<\/strong> The data center industry needs more trade skills, such as electricians and construction workers and there is a big gap between supply and demand.<\/li>\n<\/ul>\n
There is also a concern about the ROI and economics of the aggressive data center and AI infrastructure build-out. Most of the hyper-scaler and AI infrastructure companies, such as Google and Microsoft, are moving from being asset-light to asset-heavy companies, raising concerns about their long-term valuations.<\/p>\n
Dual requirements between training and inference<\/h2>\n
Data centers and AI infrastructure will also have to deal with different requirements \u2014 power-hungry training needs versus latency-critical inference. Training workloads need high power densities and advanced liquid cooling techniques. Inference workloads need lower power densities, but low latency is critical and this would mean co-location with the applications and data workloads. In addition, inference workloads require creating a high-volume \u201calways-on\u201d background load.<\/p>\n
According to a McKinsey study<\/a>, AI compute is moving towards an inference-heavy future with training and inference needs being approximately 50-50 by 2030.<\/p>\n<\/div>\n\nData centers will have to align with this reality and combine both training and inference capabilities within the same campus.<\/p>\n
Mitigation initiatives<\/h2>\n1. Government and industry partnership<\/h3>\n
The industry has worked aggressively with the Federal Government to heighten the awareness of the energy needs for AI and is working on several strategies to mitigate this constraint. Power generation is one area where the US is playing catch-up with China, and there is a concern that this might make all the difference when it comes to winning the AI race.<\/p>\n
\n- Nuclear renaissance.<\/strong> The administration\u2019s stated policy is to unleash American energy through a series of investments, public-private partnerships and deregulation<\/a>. Innovations such as on-site generation and micro-grids are being adopted with support from the Department of Energy (DOE). DOE has taken numerous\u00a0actions<\/a>\u00a0to accelerate the development of next-generation<\/a> nuclear technology. Small Modular reactors and advanced nuclear technologies are being supported through the DOE\u2019s programs. Significant investments are being made in research to harness nuclear fusion<\/a>.<\/li>\n
- Regulatory changes.<\/strong> There are also regulatory initiatives at the Federal and state levels<\/a> to insulate residential rate payers from significant cost increases due to data center power usage to prevent backlash from average citizens<\/a>.<\/li>\n<\/ul>\n
2. Innovation and investments<\/h3>\n\n- Chip design.<\/strong> Several architectural techniques, such as in-memory, wafer-scale and photonic, are being developed to drive down energy consumption.<\/li>\n
- Software techniques.<\/strong> Several software techniques can dramatically reduce energy consumption during AI model training<\/a> without requiring new hardware infrastructure. One example of such a technique is \u201cHyperparameter optimization and early stopping.\u201d<\/li>\n
- Advanced cooling solutions.<\/strong> These include \u201cDirect to chip liquid cooling\u201d and \u201cimmersion cooling,\u201d which have the potential to reduce energy consumption significantly.<\/li>\n
- Investments.<\/strong> Electric and gas utility capex is expected to surpass US $1 trillion cumulatively within the next five years (2025\u20132029)<\/a>, and most of this is driven by AI demand.<\/li>\n<\/ul>\n
What CIO\u2019s should take into consideration<\/h2>\n
CIO\u2019s need to be aware of the above-mentioned correlation between energy constraints and the future availability of AI capacity and take this into account as part of their longer-term AI roadmap. Here are some of the practical steps that the CIO\u2019s should consider:<\/p>\n<\/div>\n
\nIncorporate the impact of energy into their AI ROI models<\/h3>\n
Power and cooling costs can materially change the economics of AI initiatives over time.<\/p>\n
In traditional enterprise IT, power costs were a background consideration. In the AI world, the impact of power and cooling is in the critical path.<\/p>\n
Demand energy transparency from vendors<\/h3>\n
CIO\u2019s should ask cloud and colocation partners about regional constraints, power sourcing and expansion timelines. Data Centers designed before large-scale GPU adoption might have limitations to scalability.<\/p>\n<\/div>\n
\nCoordinate beyond IT<\/h3>\n
CIO\u2019s should involve Facilities, procurement, finance and sustainability teams to seek their inputs and they can help impact AI success.<\/p>\n
Plan for resilience, not just scale<\/h2>\n
If all AI workloads live in one environment, risk is concentrated. Hybrid models become more relevant for energy predictability and risk management.<\/p>\n
Mission-critical AI systems may justify on-site generation or microgrid investments.<\/p>\n<\/div>\n
\nAs enterprises move towards adopting AI at scale, CIO\u2019s, CAIO\u2019s and other leaders should pay close attention to the data center economics that is driven significantly by energy considerations. This will enable them tune their AI strategy to ensure that there is more predictability in costs and enable them to deliver the ROI that the business expects.<\/p>\n
This article is published as part of the Foundry Expert Contributor Network.<\/strong>
Want to join?<\/a><\/strong><\/p>\n<\/div><\/div>\n<\/p><\/div>\n\n\n\t\t\t\tSUBSCRIBE TO OUR NEWSLETTER\t\t\t<\/p>\n
\n\t\t\t\tFrom our editors straight to your inbox\t\t\t<\/h3>\n
\n\t\t\t\tGet started by entering your email address below.\t\t\t<\/p>\n<\/p><\/div>\n<\/p><\/div>\n
\n\n![\"bitcoins](\"https:\/\/www.cio.com\/wp-content\/uploads\/2026\/02\/11786-0-67733500-1771326139-author_photo_Hari-Subramanian_1754915795.jpg?quality=50&strip=all&w=224\")
\t\t\t\t\t\t\t\t<\/p>\n<\/p><\/div>\n
\n\n
For the last couple of years, enterprises have doubled and tripled down on investments in AI-related initiatives. The board-level leadership at the Global 1000 enterprises has high expectations of the value that can be unleashed through the power of AI in growing the business as well as driving efficiencies. CIO and CAIO organizations have spent a lot of time and energy on addressing constraints such as data availability, governance and change management to enable value realization through AI initiatives. For the most part, enterprises have assumed unconstrained access to AI infrastructure through hyper-scalers. The exponential reduction in token costs has enabled broader adoption of AI use cases within enterprises.<\/p>\n
As generative AI, agentic systems and real-time inference move from pilots into production, CIO\u2019s and enterprise AI leaders would be well advised to be cognizant of another constraint:\u00a0energy availability and its impacts AI cost, scale and risk. Power, cooling and physical infrastructure and have not been commonly discussed within CIO organizations as a potential constraint.<\/p>\n
This article outlines AI\u2019s energy wake-up call and why CIOs should pay attention to the impact of energy on AI while building their longer-term AI strategy.<\/p>\n<\/div>\n
AI\u2019s demand for power<\/h2>\n
According to a study by Bain and Company<\/a>, AI Data centers and their commensurate needs for power are growing exponentially and are pushing towards 100 Gigawatts of new power demand in the US by 2030. For reference, the data center power demand in 2025 is about 30 Gigawatts and this represents a 35% CAGR over the next 5 years.<\/p>\n Hyper-scalers are investing billions of dollars and are racing to build data centers. Investment in data centers are expected to reach $ 1 trillion within three years, according to a study by Deloitte<\/a>.<\/p>\n However, they face several challenges, such as:<\/p>\n<\/div>\n There is also a concern about the ROI and economics of the aggressive data center and AI infrastructure build-out. Most of the hyper-scaler and AI infrastructure companies, such as Google and Microsoft, are moving from being asset-light to asset-heavy companies, raising concerns about their long-term valuations.<\/p>\n Data centers and AI infrastructure will also have to deal with different requirements \u2014 power-hungry training needs versus latency-critical inference. Training workloads need high power densities and advanced liquid cooling techniques. Inference workloads need lower power densities, but low latency is critical and this would mean co-location with the applications and data workloads. In addition, inference workloads require creating a high-volume \u201calways-on\u201d background load.<\/p>\n According to a McKinsey study<\/a>, AI compute is moving towards an inference-heavy future with training and inference needs being approximately 50-50 by 2030.<\/p>\n<\/div>\n Data centers will have to align with this reality and combine both training and inference capabilities within the same campus.<\/p>\n The industry has worked aggressively with the Federal Government to heighten the awareness of the energy needs for AI and is working on several strategies to mitigate this constraint. Power generation is one area where the US is playing catch-up with China, and there is a concern that this might make all the difference when it comes to winning the AI race.<\/p>\n CIO\u2019s need to be aware of the above-mentioned correlation between energy constraints and the future availability of AI capacity and take this into account as part of their longer-term AI roadmap. Here are some of the practical steps that the CIO\u2019s should consider:<\/p>\n<\/div>\n Power and cooling costs can materially change the economics of AI initiatives over time.<\/p>\n In traditional enterprise IT, power costs were a background consideration. In the AI world, the impact of power and cooling is in the critical path.<\/p>\n CIO\u2019s should ask cloud and colocation partners about regional constraints, power sourcing and expansion timelines. Data Centers designed before large-scale GPU adoption might have limitations to scalability.<\/p>\n<\/div>\n CIO\u2019s should involve Facilities, procurement, finance and sustainability teams to seek their inputs and they can help impact AI success.<\/p>\n If all AI workloads live in one environment, risk is concentrated. Hybrid models become more relevant for energy predictability and risk management.<\/p>\n Mission-critical AI systems may justify on-site generation or microgrid investments.<\/p>\n<\/div>\n As enterprises move towards adopting AI at scale, CIO\u2019s, CAIO\u2019s and other leaders should pay close attention to the data center economics that is driven significantly by energy considerations. This will enable them tune their AI strategy to ensure that there is more predictability in costs and enable them to deliver the ROI that the business expects.<\/p>\n This article is published as part of the Foundry Expert Contributor Network.<\/strong> \n\t\t\t\tSUBSCRIBE TO OUR NEWSLETTER\t\t\t<\/p>\n \n\t\t\t\tGet started by entering your email address below.\t\t\t<\/p>\n<\/p><\/div>\n<\/p><\/div>\n\n
Dual requirements between training and inference<\/h2>\n
Mitigation initiatives<\/h2>\n
1. Government and industry partnership<\/h3>\n
\n
2. Innovation and investments<\/h3>\n
\n
What CIO\u2019s should take into consideration<\/h2>\n
Incorporate the impact of energy into their AI ROI models<\/h3>\n
Demand energy transparency from vendors<\/h3>\n
Coordinate beyond IT<\/h3>\n
Plan for resilience, not just scale<\/h2>\n
Want to join?<\/a><\/strong><\/p>\n<\/div><\/div>\n<\/p><\/div>\n\n\t\t\t\tFrom our editors straight to your inbox\t\t\t<\/h3>\n
\t\t\t\t\t\t\t\t<\/p>\n<\/p><\/div>\n