Docs

Discover how Phala's AI Agent Contract offers the essential tools to develop and profit from intelligent applications.

Explore Now

Phala and io.net create Strategic Partnership to Enhance GPU-TEE 

2024-09-26

We are thrilled to announce a new partnership between Phala Network and io.net, aimed at advancing secure computation and decentralized AI.

Since launching its mainnet in 2021, Phala Network has built a robust infrastructure of over 30,000 TEE CPU nodes, enabling web3 developers to offload complex computations from smart contracts to Phala’s secure, off-chain network. These nodes play a pivotal role in maintaining data privacy and security while delivering verifiable proofs and oracles, supporting a wide range of web3 applications from social apps to AI-driven agents.

With Phala’s recent benchmark for TEE-enabled GPUs announcement, it’s continuing to mark a new era in secure, high-performance decentralized AI. This benchmark evaluates the performance of Nvidia’s H100 and H200 GPUs when integrated with Phala’s TEE technology, offering the computational power required for training and running large AI models like LLaMA 3 and Microsoft Phi, while upholding the highest security and privacy standards.

Read the latest GPU-TEE benchmark release on cointelegraph here.

In partnership with io.net, Phala is taking its vision of decentralized AI to the next level by accessing GPU hardware via io.net’s cloud network, leveraging Nvidia’s H100 and H200 GPUs.

By extending Trusted Execution Environments (TEEs) to include AI accelerators like GPUs, this collaboration ensures that sensitive AI workloads are securely processed, with advanced cryptographic protections. Nvidia’s H100 Tensor Core GPUs, equipped with confidential computing features such as encrypted memory and secure boot, further enhance this security layer.

The IO Cloud enables users to deploy and manage decentralized GPU clusters on demand, offering access to powerful GPU resources without the need for costly hardware investments or complex infrastructure management. By delivering a cloud-like experience, IO Cloud democratizes GPU access for ML engineers and developers, making advanced computing power more accessible and affordable by offering up to 90% savings compared to traditional cloud services.

With seamless integration through the IO SDK, users can easily tap into globally distributed GPU resources, acting as a CDN for machine learning and bringing computation closer to end users. Built on the proven RAY framework used by OpenAI, it enables simple scaling of Python applications. Additionally, users can look forward to future access to advanced features like the IO Models Store, serverless inference, cloud gaming, and pixel streaming

This partnership with io.net represents a major advancement in Phala’s mission to democratize decentralized AI, delivering secure and transparent systems that make AI technology more accessible to a wider range of users.

Together, Phala and io.net will conduct research, testing and benchmarking, starting with cutting-edge NVIDIA H100s and H200s. This collaboration will explore deploying Phala Network’s autonomous AI agents and AI agent contracts on the IO Network as well as integrating Phala Network’s TEE hardware and workers into the IO Network of GPUs.

Both parties will explore deeper integrations between the IO Network and Phala Network as we continue to develop our technical roadmaps.

About io.net

io.net is a decentralized distributed compute network that enables ML engineers to deploy a GPU cluster of any scale within seconds at a fraction of the cost of centralized cloud providers. io.net sources compute resources from multiple locations and deploys them into a single cluster at massive scale. io.net has successfully supported training, fine tuning, and inference for a wide range of ML models.

About Phala

Phala is a pioneer in confidential computing and secure data processing. They specialize in leveraging Trusted Execution Environments (TEEs) and secure enclaves to enable secure and verifiable computations. Their expertise in confidential computing makes them a valuable partner in advancing the field of verifiable AI computing.

About Phala

Phala Network is a decentralized cloud that offers secure and scalable computing for Web3.

With Phat Contracts, an innovative programming model enabling trustless off-chain computation, developers can create new Web3 use cases.

Get the latest Phala Content Straight To Your Inbox.