AI sovereignty and AI reasoning: The future of decentralized intelligence

By Yoram Novick, CEO, Zadara
NVIDIA GTC 2025 once again delivered a showcase of groundbreaking advancements in AI, outlining key trends and developments from NVIDIA and its massive ecosystem. The conference provided a great opportunity to engage with industry leaders – all at the forefront of AI innovation. While much has been said about CEO Jensen Huang’s visionary keynote and the numerous announcements made, this article reflects on the major trends observed, particularly in comparison to last year’s GTC.
One thing is certain: the AI landscape is evolving rapidly, driven by the growing demand for scalable, secure, yet decentralized infrastructure. As organizations seek greater autonomy over their AI while maximizing the value of their proprietary data with the latest AI technologies, two key trends are emerging as critical priorities: AI sovereignty and AI reasoning. These trends are shaping the future of AI deployment, influencing strategies across industries, from enterprises and telecom providers to cloud service providers and beyond.
AI sovereignty: controlling AI data and infrastructure
AI sovereignty is gaining momentum as organizations and governments recognize the importance of controlling their AI infrastructure, data and decision-making processes. This shift is driven by geo-political factors, regulatory compliance requirements, and a growing emphasis on reducing reliance on centralized AI providers.
Countries and enterprises are increasingly investing in local AI infrastructure to maintain control over sensitive data and mitigate the risks associated with external dependencies. AI sovereignty extends beyond data storage and includes governance over model training, inferencing, and reasoning. By leveraging sovereign architectures, organizations can ensure compliance with regional regulations, enhance data security, and maintain operational independence.
For telecom providers and enterprises, AI sovereignty also means deploying AI capabilities at the edge to improve performance, reduce latency, and minimize exposure to external control. Edge AI deployments allow for real-time processing while preserving data privacy, a critical requirement for industries such as healthcare, finance, and government operations.
AI reasoning: The next frontier in AI inferencing
AI reasoning represents a significant advancement beyond traditional AI inferencing. Inferencing involves executing pre-trained models on new data, where AI reasoning focuses on decision-making in the moment, contextual understanding, and problem-solving. This shift requires a great deal more computational power and a sophisticated approach to AI infrastructure.
Unlike AI training, which benefits from centralized compute environments, AI reasoning is best served by distributed AI infrastructure that operates closer to end-users. Decentralized AI environments, including AI factories and sovereign cloud platforms, are becoming essential for supporting AI reasoning workloads. These environments enable real-time decision-making, allowing AI systems to process complex data and generate insights with minimal latency.
Building the infrastructure for AI sovereignty and AI reasoning
To support the growing needs of AI sovereignty and AI reasoning, organizations must invest in scalable and secure AI infrastructure or leverage sovereign cloud providers that natively support scalable secured multi-tenancy. This will include decentralized architectures that reduce reliance on hyperscalers and support on-premises, edge and hybrid deployments. Additionally, high-performance compute environments optimized for AI reasoning will ensure low-latency processing and real-time adaptability.
As AI continues to shape industries, the ability to maintain control over infrastructure and empower reasoning will be critical for organizations and sovereign cloud providers looking to leverage AI responsibly and effectively. The shift toward AI sovereignty and AI reasoning marks the next stage in AI evolution, ensuring that it remains both powerful and secure in an increasingly decentralized world.
About the author
Yoram Novick is the President and CEO of Zadara. He has deep expertise in enterprise systems, cloud computing, storage and software and a proven track record of over 25 years of building successful startups. Yoram holds 25 patents in the systems, storage, and cloud domains.
Pulsant acquires SCC data centers to boost UK edge coverage
Article Topics
AI reasoning | AI sovereignty | decentralized infrastructure | NVIDIA GTC 2025 | scalable AI | secure AI infrastructure
Comments