jina-ai/serve ? reverse-engineered prompt
Reverse engineered prompt
Build me a Python framework for serving AI models as real services, not just scripts.
I want to be able to define a small input and output schema, write an Executor class with a request handler, and then expose it over HTTP, gRPC, and WebSockets. It should make it easy to run locally, stream generated text token by token, and connect multiple services together into a simple pipeline. Please include a way to start a Deployment from Python, run a Flow with more than one step, and support scaling with replicas, sharding, and batching.
Also make it easy to package and deploy the same service with Docker, Docker Compose, Kubernetes, and a cloud deployment command. If you need to, look up the current docs online so the examples and setup are accurate.
Are you gonna build this?
make sure you review the code using coderabbit