Categories / AI & Machine Learning / LLM & Generative AI Platforms

LLM & Generative AI Platforms

LLM and generative AI platforms give organisations a managed way to build applications on large language models. Instead of wiring models, data and infrastructure together by hand, teams get model access, tooling to ground answers in company data, and controls for security, cost and quality in one place.

Typical capabilities include access to multiple commercial and open models, retrieval-augmented generation (RAG) over your documents, fine-tuning, prompt management, evaluation, and guardrails that filter unsafe or sensitive output. Many also handle hosting and scaling, so applications can move from prototype to production.

The right platform depends on which models you want to use, where your data has to stay, how much you plan to customise models, and how you will measure accuracy and control spend once usage grows.

Compare 110 llm & generative ai platforms below, or open the full directory to filter by your whole stack.

  • AI21 Labs Jurassic-2

    AI21 Labs

    AI21 Labs specializes in building large language models and natural language processing solutions. Their Jurassic-2 model offers advanced capabilities for text generation, summarization, and understanding. AI21 Labs aims

  • Amazon Bedrock

    Amazon Web Services (AWS)

    Amazon Bedrock offers a comprehensive suite of AI and machine learning services, including Generative AI capabilities. AWS emphasizes providing scalable and cost-effective AI solutions for businesses of all sizes. Their…

  • Anthropic API

    Anthropic

    Provides access to Anthropic's advanced AI models for developers to integrate into their applications.

  • Claude

    Anthropic

    A large language model designed for helpful, honest, and harmless conversations and tasks.

  • Anyscale Platform

    Anyscale

    A unified, managed compute platform built on Ray for building, deploying, and scaling AI and Python workloads across any cloud.

  • Anyscale Runtime

    Anyscale

    Proprietary optimizations for Ray workloads, enhancing performance and efficiency across the AI pipeline.

  • Lumina

    Artefact

    A custom-built Gen AI tool designed to assist business leaders in responding more effectively and rapidly to company tenders.

  • AI Agent Studio

    Automation Anywhere

    A low-code workspace for creating and managing custom AI agents to responsibly execute cognitive tasks within enterprise automation workflows.

  • AI Model Deployment

    Baseten

    Facilitates the quick and reliable deployment of machine learning models into production environments.

  • Baseten Platform

    Baseten

    A cloud-native platform for building, deploying, and scaling AI models efficiently and cost-effectively.

  • Model Orchestration

    Baseten

    Tools and features to manage complex AI model workflows, including versioning, testing, and deployment pipelines.

  • Serverless Inference

    Baseten

    Deploy AI models as serverless APIs, automatically scaling to meet demand and reducing operational overhead.

  • C3 AI Suite

    C3.ai

    C3 AI Suite is a platform for developing and deploying enterprise AI applications, focusing on industries like energy, manufacturing, and financial services. Integrating with MongoDB Atlas enables the storage and process

  • Agentic Data Stack

    ClickHouse

    A data stack designed for building AI-powered applications, leveraging ClickHouse for performance.

  • Agent Foundry

    Cognizant

    A platform or service focused on developing and deploying AI agents for various business applications.

  • Cohere API

    Cohere

    Cohere offers a powerful API for natural language processing tasks, focusing on generation and understanding. Their models are designed for enterprise use, emphasizing safety, reliability, and control. They support a wid

  • Cohere Generate

    Cohere

    Cohere Generate is a leading generative AI platform that enables businesses to create high-quality content, automate tasks, and build intelligent applications. The platform leverages advanced natural language processing…

  • Cohere's Language AI Platform

    Cohere

    Cohere offers a language AI platform enabling businesses to build and deploy sophisticated natural language applications. Their platform provides access to powerful language models and tools for customization. Cohere foc

  • Brand Voice

    Copy.ai

    Defines the unique personality of a brand to ensure consistent and authentic content outputs.

  • GTM AI Platform

    Copy.ai

    An AI platform designed to automate tasks, connect teams, and drive go-to-market strategies across various business functions.

  • Infobase

    Copy.ai

    A centralized repository for company information to inform and guide AI content generation.

  • Product Description Generator

    Copy.ai

    An AI-powered tool to create engaging and persuasive product descriptions that highlight features and benefits.

  • Sales Copy Generator

    Copy.ai

    Generates high-converting, persuasive sales copy instantly to boost conversions.

  • AI Services

    Couchbase

    AI-enabled services for agent development and deployment, accelerating AI initiatives by keeping data and AI workloads on a single platform.

  • Capella iQ

    Couchbase

    An AI-powered coding assistant designed to help developers get started quickly and optimize queries using natural language.

  • Creative Reality™ Studio

    D-ID

    D-ID specializes in Generative AI video creation, allowing users to generate realistic talking avatars from text or audio inputs. Their Creative Reality™ Studio platform facilitates the creation of engaging and personali

  • DataRobot AI Cloud

    DataRobot

    DataRobot AI Cloud offers automated machine learning for building and deploying AI applications. Tableau is a data visualization and business intelligence platform. Integrating DataRobot with Tableau enables users to eas

  • MosaicML Training Platform

    Databricks

    MosaicML helps organizations train large language models (LLMs) efficiently and cost-effectively. Their training platform focuses on optimizing hardware utilization and reducing training costs. Integrating with Databrick

  • AI Agents

    Dataiku

    Build and deploy AI agents grounded in enterprise data, pipelines, and models for automated reasoning and task execution.

  • LLM Mesh

    Dataiku

    Abstracts and switches LLM providers with centralized routing, quotas, monitoring, and safety controls for managing cost and risk at scale.

What to look for in llm & generative ai platforms

  • Model choice: access to several commercial and open-source models, and freedom to switch.
  • Grounding on your data: built-in retrieval (RAG), connectors and vector search.
  • Customisation: prompt management and fine-tuning options.
  • Evaluation and quality: tools to test accuracy, measure hallucinations and compare versions.
  • Security and privacy: data residency, no training on your data, access controls and audit logs.
  • Guardrails: filtering for unsafe, biased or sensitive output.
  • Cost visibility: usage tracking, budgets and caching to keep spend predictable.

Frequently asked questions

What is an LLM platform?

An LLM platform is a service or toolkit for building applications on large language models. It typically bundles model access, tools for connecting company data, evaluation, guardrails and deployment, so teams don't assemble each piece themselves.

What is retrieval-augmented generation (RAG)?

RAG grounds a language model's answers in your own content: the platform retrieves relevant documents and passes them to the model with the question, which improves accuracy and lets answers cite their sources.

Should we fine-tune a model or use RAG?

RAG is usually the first step when answers need to reflect your current documents and data. Fine-tuning helps when you need a model to follow a specific style, format or specialised task consistently. Many teams use both.

How do enterprises keep LLM use secure?

By choosing platforms that keep data in approved regions, don't use customer data for training, enforce access controls, log usage, and apply guardrails to inputs and outputs.

Related categories

  • Vector Database
  • Retrieval-Augmented Generation (RAG)
  • AI / LLM Observability & Evaluation
  • AI Agents & Orchestration
Explore the full directory →