19Kdl/month
6likes
Identifier
Model ID
HumanCompatibleAI/ppo-Pendulum-v1Tags
stable-baselines3Pendulum-v1deep-reinforcement-learningreinforcement-learningmodel-indexregion:us
Use ppo-Pendulum-v1 on Mixpeek
Build multimodal processing pipelines with this model and others. Extract features, run inference, and set up retrieval in Mixpeek Studio.
Open StudioHow It Runs on Mixpeek
On Mixpeek, ppo-Pendulum-v1 runs as a managed extractor inside a processing pipeline. Point a bucket of reinforcement learning data at it, and Mixpeek handles GPU provisioning, batching, retries, and writing the outputs into a vector store you can query.
Extractor outputs land in the Mixpeek Vector Store (MVS), where you can combine them with retrieval, reranking, and filter stages to build end-to-end search and agent-perception pipelines, no model-serving infrastructure to maintain.
Specification
OrganizationHumanCompatibleAI
TaskReinforcement Learning
Librarystable-baselines3
Downloads/mo19K
Likes6
View on HuggingFace
See model card, files, and community discussion
Related Reinforcement Learning Models
HumanCompatibleAI/ppo-seals-CartPole-v0
45K
mradermacher/AReaL-SEA-235B-A22B-i1-GGUF
15K
TianheWu/VisualQuality-R1-7B
9K
mradermacher/Aryabhata-2.0-i1-GGUF
5K
mradermacher/SpatialThinker-30B-i1-GGUF
4K
mradermacher/GoLongRL-4B-i1-GGUF
3K
mradermacher/TinyResearcher-i1-GGUF
3K
mradermacher/Vero-Qwen35-9B-Base-i1-GGUF
3K