bilal-512/AI_Inference_Runtime ? reverse-engineered prompt

Reverse engineered prompt

Build me a small C++ AI inference runtime that can load a model, run predictions on input data, and return the results in a simple way.

I want it to feel like a clean library I can use from another C++ app, with a few example programs showing how to call it, and some basic tests so I know it works. Please make the project easy to build with CMake, keep the public headers in a sensible place, and organize the source so it is straightforward to extend later.

If you need to check current C++ or build best practices, look up the latest docs online. I mainly care that the runtime is usable, the examples are clear, and the code is tidy enough that I can add more AI model support later without rewriting everything.

Are you gonna build this?

make sure you review the code using coderabbit

Try freeSponsored — opens CodeRabbit in a new tab