AI Development Platforms
Monitoring & Observability
- Helicone (Review) - LLM monitoring and observability platform
- Arize (Review) - ML observability for production AI
- Portkey (Review) - API monitoring and analytics
- Weights & Biases (Review) - MLOps platform for experiment tracking
- Neptune.ai (Review) - Metadata store for MLOps
- WhyLabs (Review) - AI observability platform
- Gantry (Review) - ML model monitoring and analytics
Development & Testing
- LastmileAI (Review) - AI development and testing platform
- Carbon (Review) - AI application development framework
- TryPromptly (Review) - Prompt engineering and testing
- AnythingLLM (Review) - Open-source LLM framework
- Galileo AI (Review) - AI evaluation and trust-building platform
- LangChain (Review) - Framework for LLM applications
- LlamaIndex (Review) - Data framework for LLM applications
- Haystack (Review) - NLP framework
- FastAPI (Review) - API framework popular for ML services
Infrastructure & Deployment
- Fireworks (Review) - AI infrastructure and deployment
- Litellm (Review) - LLM deployment and management
- Vectorshift (Review) - Vector database management
- Zenbase (Review) - AI infrastructure platform
- Modal (Review) - Cloud platform for AI deployment
- Replicate (Review) - Platform for deploying ML models
- BentoML (Review) - ML model serving framework
- Beam (Review) - Serverless ML infrastructure
Data Processing & Management
- Unstructured (Review) - Data preprocessing for AI
- Superlinked (Review) - AI data management platform
- Weaviate (Review) - Vector database
- Pinecone (Review) - Vector database
- Milvus (Review) - Vector database
- LanceDB (Review) - Embedded vector database
- MindsDB (Review) - AI database platform
- DVC (Review) - Data version control
- Crawl4AI (Review) - Open-source LLM Friendly Web Crawler & Scraper
Prompt Management
- PromptLayer (Review) - Prompt versioning and management
- LangSmith (Review) - LLM development platform
- Humanloop (Review) - Prompt management platform
- Promptfoo (Review) - Prompt testing and evaluation
- GPTCache (Review) - LLM response caching
- Hamilton (Review) - Prompt orchestration
Security & Compliance
- Lakera (Review) - LLM security testing
- Protecto (Review) - AI data privacy
- Patronus AI (Review) - LLM security monitoring
- Guardrails (Review) - LLM security monitoring
AI-Powered Development Tools
- Aider (Review) - AI Pair Programming in Terminal
- Replit AI (Review) - AI-powered coding environment
- Pieces (Review) - AI-enhanced developer toolkit
- Bolt.new (Review) - AI-powered web app builder
- Databutton (Review) - Data apps development platform
RAG (Retrieval Augmented Generation)
- SWIRL (Review) - Open-source AI infrastructure for RAG applications
- Cognita (Review) - Framework for modular, production-ready RAG systems
- LLM-Ware (Review) - Framework for enterprise-ready RAG pipelines
- RAG Flow (Review) - Engine for RAG using deep document understanding
- Graph RAG (Review) - Graph-based RAG system using knowledge graphs
- Haystack (Review) - AI orchestration framework for LLM applications
- Storm (Review) - LLM-powered knowledge curation system
Additional Resources
Each platform typically offers:
- Documentation
- API References
- Getting Started Guides
- Integration Examples
- Community Forums
- Developer Discord/Slack channels