Confidential AI and decentralized confidential computing - Martin Leclercq | iExec

Hi everyone, I'm Martin De atexc and today we're going to talk about confidential AI and decentralized confidential computing. For the hackathon, you just need a few technical prerequisite a wallet node docker and a docker hub and then the highix package. Easy. So if you got any question, you can comment at the booth or feel free to ask directly on Discord. Small sum up, the price, okay, 6,000 USDC for the first one and the Hello World raffle you can win just by doing our hello world journey.

It's easy like there. You just need to do each chapters there and you can enter the raffle. So, it's definitely easy money. And the surprise, the surprise prize, it's in case your project is really cool, but you don't win. We just got a little 300 more for you.

How win the exxunty? It's honestly really easy. Come at the booth, challenge your idea. Need some We need data set type. You will understand what I'm talking about just after.

Hello. Come. It's a huge party here. Um, check out the inspiration builders for sure. We provided some idea and some you can you can uh follow our idea or be creative.

Don't forget to fill the feedback form. Stick to the evaluation criteria, you know, and we love AI. So if you are doing something with AI it's even better. So let's talk about confidential computing. Typical security m protect data at rest.

It means encrypted and stored uh in a server or in transit through different network. But the real problem is how you can protect data in use because when an application process a data it must see the data. So it means the data remain unencrypted and it's exactly where the malicious um hacker can can uh come. So we are using it's a hardware based technology where with Intel SJX chipset and TDX and this chipset provide a small part in this memory create what we call an enclave a TE trusted execution environment. Everything that happen in it remain confidential and totally private.

Even the CIS ad mean the cloud admin, nobody can access the data. It's really a black box. Two key features isolation because it's totally isolate from the rest of the computer and attestation report. You can prove that the data has has been uh computed in this uh black box. And if we do zoom in the TE the exx we are running two things database it means you can store secret private key API key whatever you want and application in this black box you can run any application able to compute data and as you can see maybe some of you recognize the Eliza OS framework work.

We are running AI model and framework in this enclave and I think you get it. It's why we can do confidential AI. So confidential computing hardware based technology we added the blockchain layer to set some governance rule data tokenization data ownership and it's the decentralized confidential computing. It can sounds a bit complex but with it's really easy. Why?

Because our tool our simple SDK npm install and then you are able to use our tool really easy. The first one data protector. What is data protector? It's an SDK helping builders to protect data. So just by insting installing our SDK and call the method protect data you are able to protect a data.

What I mean by protect data it's when you click on the button protect data it's there is three step the data is encrypted with a symmetric key. The symmetric key is dropped in the database running in the enclave and the encrypted data is dropped on a decentralized public storage like IPFS or awe and the last step it calls data protector smart contract and it create the ownership of the data it means you are owning your data with an NFT so I don't think I will Time to make the demo. We added a flexible monetization mechanism because I can protect my data. For instance, I will protect my mail and I will authorize you to use this data, but I want you to pay $10 to use my data and you can do the same with subscription renting data. It's really cool.

It's called data protector sharing sharing and it's a add-on of data protector and the same same it's really easy to use just call the right method I talked about data set type it's exactly why we are here today at isbelgrad with this tool you can protect any kind of data and we want builders to protect any kind of data trying to protect I don't know a passport uh uh ID card legal document and it's what we call data set type. We need it because for the clarity, for the safety and the structure and you will understand why because just after this data must be computed in this private environment thanks to the EXC application. So if you are hacking today, how you can declare declare a data set type? It's really easy. It's a simple JSON.

If it's an email, you can set email, but it's already existing. So, it's a already use this use case is done. But it's a if it's a passport, you just need to write passport, etc. And I've done a really complete doc explaining from A to Zed how you can protect it, what it means and everything is available in the is Belgrad buntigid. Sorry.

So I protected my data with data protector. I need to grant access to someone. I will grant access with the method grant access. As you can see, you need to add three four parameters. The first one, the protect data because when you are protecting your data, you have in return a blockchain address.

Then the authorized user, it could be you. So I just need your wallet. And the third one, the authorized DAP. It's an application running in the enclave able to compute protected data. An exec application.

Yeah. This application is able to compute data. Yeah, I already said it. And it might sounds complex like wow confidential computing, decentralized confidential computing. Wow, crazy how hard it is.

It's really easy cuz for data protector, let me make the demo because it's a technical workshop. All right, let me zoom a bit. Perfect. Okay, I want to bootstrap a privacy preserving application compatible with SJX or TDX. Easy.

I just need to install the package then then I app in it. Oh my god. Hello world. Oh, do I need I want to code in JavaScript or Python? I will stay in JavaScript and I will keep Hello World.

It's the easier uh setup. And then here we go. I've got Oh, it's always one end code up. I've got an application. I just bootstrapped in two line in one command line an application able to compute data in a te easy.

So you for this hackathon you just need to custom this uh application and we've got a bunch of example. So let's continue again. Data set type. You need to declare a data set type when you are protecting data with data protector and the application will proc will process the data. You need to declare it the same.

Why? Because application will recognize the producted data. It must match. And we are providing everything you need to well declare and win this hackathon in every in all the documentation. And if you got any question sure come to the booth just wrap up the IAB generator access TE easily confidential computing.

Select your project mode. You can code in JavaScript or Python. You can deploy I app because I app in it. Okay, cool. I've got my application.

I customing I I'm customing it and then just I have deploy and I'm deploying it in this enclave in the TE easy. workflow just to explain like for instance I'm coming on the isbeld platform I'm protecting my I will protect my mail for instance I will authorize is Belgrad to use my email my protected email and I will authorize an application to compute this email so at the end is Belgrad will be able to use my email with the authorized application existing use case web 3 mail. It's exactly what I just said. It's a you are able to send email uh to an Ethereum address without knowing or storing the email. Content delivery.

You can send and monetize your protected data with everybody. But what we want to for this hackathon it's new use case, new data, new confidential data computing use case. Honestly, it's easy money. So, talking about application running in this enclave, what we've done, we've done confidential AI. What is confidential AI?

It's an AI model or framework running in this enclave. So, it means you can even chat with the AI model in a confidential way. You can ask it, you can ask the AI model to compute data in a private way. And we've done a project with Eliza OS. I think you already everybody know this amazing project.

So Eliza OS is currently managing a Twitter account in this confidential space and there is a lot of use cases honestly data a lot of data is private uh it can be research data finance healthcare and a lot more so I think you just need to be creative for this hackathon and let's you win and yeah again how you can win this hackathon I think the the if you need to keep in mind. One things in this list is just come to the boss, challenge your idea, ask question and we will be there here to help you until late and usually I think we are the the protocol um that will stay the whole night and what comes next? It's news and let's go. Any questions?

Yeah. No, we are providing everything.

Yeah. Yeah, we've got a network. That's a really good question. We've got our side chain called Belur. It's an EVM compatible and this side chain is composed with worker and each worker already get this technology.

So when you are protecting a data and you are computing it with our tool you don't need you don't need uh a special hardware we are providing everything so you will trigger a confidential task and this task will be compute on another computer but as it's in an enclave you don't care even if it's a malicious dark vador uh hacker um far in the galaxy you can you don't you you don't need to be afraid because it's an enclave even the actor can can can access to it. So, oh yeah, sure. Yeah, yeah, sure. You can you can join the party with your your hardware. Uh other questions?

Cool. Uh do we have a few minutes left or Okay, cool. So let's go back if you if you are okay. Let's go back to how you can protect data cuz it's pretty really really pretty really pretty really pretty really pretty really pretty really pretty really pretty really pretty really pretty really pretty really really easy up up okay it's loading I will show you how you can protect the data with data protector for this hackathon. You you just need to protect the data with data protector and even monetize it if you want and compute the data.

So let's protect my mail. Okay, now you've got my mail. So if you want to send some send me some money, you can test. Oh, let's create. Okay.

And three, two, one. Demo effect. It should come. Oh, sorry. I Yeah, it's my my Okay, great.

your data has been protected and in return I've got a blockchain address. So it's exactly when I clicked on this button it there the data has been encrypted symmetric key the data has been dropped on IPFS and we call the smart contract data protector and the cool stuff I have two cool stuff yet uh wait and just after you can grant access to someone and I will grant access to me for instance up for the demo Oh, okay. And waiting. Let me show you the other really, really, really, really cool stuff. And I think after this info, everybody will act on exec.

Okay, let's finish. Should I start? Does it work? Okay. Yeah.

Perfect. Okay. Access successfully granted. I just protect the data. Authorize myself.

So the moment I can authorize you to use this data and then you need to authorize in the same process you will authorize an exac application you build during this time. And drum roll we are providing a opensource GitHub repo with Nexjs data protector and real own wallet app kit. So basically you already have your front end. Just need to make some vibe coding with cursor with beautiful Tailwind stuff and let's go. You just need to build your EXC application and win this hackon.

That's cool. I see you are. Wow, that's crazy. Yeah. And you want to clap a lot because it was so amazing.

A question.

Yeah. Yeah. Yeah. Sure. You can authorize someone and uh you just need to authorize a wallet.

So you can authorize a a smart account wallet. You can authorize whoever you want and then you can process the data the way you want. You just need a yeah a protected data an ex application able to compute it. But in in the real life I will protect my data. You will build an EXC application.

I will authorize you to compute my data. In the in real life there is two two part for this demo. You will build the you will use you both the both tool. All right. I I still have some time.

I was Yeah, it was really fast. I I think I I talked too fast. My English teacher told me that I should slow down. So now what I uh Okay. Yeah, sure.

Definitely. So basically what what happened when um I'm I protect the data. So at the end we've got a kind of marketplace. There is a requesttor the worker able to compute data with this cool hardware technology. Uh we've got the EXC application running in the TE and the fourth one the requesttor the the worker.

What is the last one? The requesttor the worker the exac application and the Oh yeah, but to seal the deal you know with the marketplace there is four actor stakeholders. Yeah. Now I was looking for each stakeholder when they are creating a deal. the requester, the worker, the IAP.

Okay. Okay. Oh, I was right. I'm the devil. I'm not too technical.

Oh, it's free. It's a gasless side chain. Really? Only good question. You're the best.

Um yeah it's a gasless side chain it's a EVM so you don't need any token you can build directly you don't need to run after any faucet so that's pretty cool you can start building and just trigger some uh some confidential computing task Yeah. No. Okay. Yeah, definitely. Um, so I will go to the last slide because it's your question is linked to a big news.

Okay. So, currently we've got a side chain a proper side chain. So, not linked to Ethereum and it's an EVM compatible and gasless side chain. If you are a builder, the build f phase is free. If you uh your project start to have some user and then you need to you will pay and we've got what we call a voucher.

A voucher is a kind of uh escro contract bag of RLC. It's our token and we are holding them for you and each time you are triggering a confidential computing task we are withdrawing we withdraw some RLC. But you're right, having a side chain, it's not the the best uh idea to to touch a bigger community. So it's exactly why we are announcing something really huge. We are deploying all all our privacy tech on L2.

So other chain link to the Ethereum and right now we are starting working with arbitrum and then maybe other so we will uh be able to provide this privacy layer tech to a bigger ecosystem to other builders. So currently for this hackathon it's on the bell core side chain but for the another the other one I think it will be in September but we will announce everything in can incan it will be on L2. Yeah. So if you want to set your worker you need uh this hardware technology you need intellig SJX or TDX it's can be quite expensive TD TDX so it's why we are providing it and if you've got it you can join the network and if you are joining the network the incentive is when you are computing data correctly and you are proving that you're computing that you computed data correctly you get some reward because each time someone will pay for a confidential computing task a part will uh be returned to the worker. Yeah.

Yeah. So if you are building a platform, the end user honestly they shouldn't have any UIX friction. So you can abstract any complexity and deal everything on your uh on the back end part and the the builder part. So if at the end after the build faz you are in the earn phase uh you will need to get a voucher and right now if you are going to if you are doing the hello world at the end you can claim a voucher. It's a $20 voucher and it's a confidential computing task.

It's around one cents. So you've got uh plenty uh you can do a lot of confidential computing task and you can claim your voucher. Yeah. And only when you just finished the build phase and if you've got a really cool idea and project let me go on this slide again. We just launched a 1 million RLC ecosystem fund.

So what is it? We are uh providing some grants for any new AI confidential AI use cases. So if you got a really cool project around confidential AI with TE with our tech uh let's let's talk together. Let's chat and see if we can uh collaborate. Yeah.

this one or the bunty one sound effect. Okay, the first one you just need to pro to have a front end able to pro for the end user able to protect the data using data protector. As I said, we are already providing a starter kit with Nex.js reown and data protector. So you get clone you check how it work and you need to um custom the data set type because uh for the starter kit it's mail I think but you need to if you are computing we are looking for new use case so if you are computing elf document scanner stuff like that you just need to add your your um the type like could be scanner doc etc.

So okay, the first pass is done. Then you need to use I app generator to bootstrap your privacy preserving application running by running I app in it. Okay, cool. I've got um I've got this application there and then you need to custom it customize it like you know is this application is just adding hello to the front of the protected data. It's a really simple one but you can do whatever you want adding uh AI model and we've got opensource uh project uh available with AI model computing data so you can take inspiration in it and everything is in our uh link tree document there uh yeah yeah everything you need there all the demo opens source GitHub repo project everything you needed there.

So protect data with ex with data protector building an exac application able to compute this data. You need new data set type declare in the front end and the back end. And that's all come to the both make a demo and win. And if you are too lazy and you don't want to code you can do the in world raffle. just follow our LOL journey doing stepbystep stuff.

It's exactly what what I just demoing and you entering the raffle. I will scan our uh worker and check every docker name uh during the hackathon um during this hackathon and I will doing a raffle and you can win $100. Is it is it clear enough? Yeah. If you have really technical question about TDEX uh SJX is there is Sedic just here the tech guy and Amen to the booth it's the research and uh research department so more complex one all right cool thanks thanks a Awesome.