Meet Kili's new audio interface: mark speaker turns on the waveform, edit transcripts segment by segment, and send them to expert review.

Explore the Audio Interface →
Product

Your Experts' Knowledge in Every Language Model

A fluent answer is not a correct one, and only your specialists can tell the difference. In Kili they evaluate LLM outputs, write and correct the examples your model is post-trained on, and annotate the text behind it, while Kili measures how far they agree.

*No credit card required. Risk-free evaluation.

Trusted by the world leaders

Features

Correct answers, not just plausible ones

Your model is judged by the people who can tell a correct answer from a convincing one. Lawyers, clinicians and analysts grade outputs against your criteria and correct the model's pre-annotations themselves, with no code and no engineer in the loop. Answers that sound right but aren't get caught before your users see them.

Explore the labeling jobs

Expert judgment becomes post-training data

Every judgment your experts make can feed the next model version. In Kili's experimental LLM projects, they rank responses from two or more models, rate single turns and whole conversations, and write a better answer when none is good enough. Conversations traced from production go through the same review, so real failures become training signal.

Read about LLM projects

Quality you can prove, on text that stays yours

You can show how reliable your evaluation and post-training data is, not just assume it. Consensus scores how far experts agree, Honeypot checks them against answers you trust, and a second reviewer signs off. Text stays in your own cloud bucket while you use Kili's cloud, or Kili runs on your own Kubernetes.

See how agreement is scored

See if Kili is the best fit for your team and your data

Speak to our team for a free 14-day evaluation.

One toolkit for LLM evaluation, post-training and text annotation

Product photo of breast cell segmentation on Kili Technology's platform
  • Named Entity Recognition with Relations

    Mark entities and link them with relations on text and PDF assets. On plain text, select at token level and propagate an entity to every occurrence.
  • Model and LLM Pre-Annotation

    Import predictions from your own model or any LLM through the SDK or API, tagged with the model's name. Experts confirm or correct each one.
  • Multi-Turn LLM Conversations (Experimental)

    Prompt two or more models, with or without a system prompt, or import existing conversations, then rate each response, each turn and the whole exchange.
Tools

Build structured datasets from all data types

Kili Technology is a complete data suite that supports all data types and handles specialized formats for domain-specific requirements.

Geospatial Imagery

Drive reliable mapping and monitoring through high-quality geospatial annotations.

OCR & Document Layout Analysis

Turn unstructured documents into usable data with accurate text extraction and streamlined review workflows.

Natural Language Processing

Annotate text for NER, classification, and sentiment analysis with collaborative workflows.

Image Annotation

Draw boxes, polygons and masks, with Meta's SAM drafting segmentations for your experts to refine.

Video Annotation

Annotate long videos seamlessly and boost productivity with advanced automation.

Audio Annotation

Build quality-focused diarization and transcription workflows to improve ASR and Speaker Diarization models for domain-specific and multilingual use cases.

I have been using Kili for 6 months now on a wide range of labeling use cases (both in computer vision and natural language processing). The stability offered by the tool is essential when you have tight deadlines and large volumes of data to annotate. Our team of over 1000 workers is accustomed to the tool, we were able to easily integrate our workforce management tool with Kili with the SSO functionality.
Kili is a powerful and easy-to-use tool for data labeling and annotation. The interface is user-friendly and offers several interesting features. The customer support team is also responsive and helpful.
Software to engage both labelers and business lines in the necessary but tedious task of labeling and annotation, served by a dedicated team to listen to your problems.
Thanks to the fact that our AI infrastructure now includes Kili Technology, we can use the tool for all kinds of projects... LCL teams can accelerate drastically the creation of their training datasets, which means a significant improvement for all the parties involved.
With the choice of Kili, we are much more confident about the future. We decided to eliminate a large part of the technical debt by choosing a solution that will be perfectly mastered across a whole range of data science and AI projects.
I have been using Kili for 6 months now on a wide range of labeling use cases (both in computer vision and natural language processing). The stability offered by the tool is essential when you have tight deadlines and large volumes of data to annotate. Our team of over 1000 workers is accustomed to the tool, we were able to easily integrate our workforce management tool with Kili with the SSO functionality.
Kili is a powerful and easy-to-use tool for data labeling and annotation. The interface is user-friendly and offers several interesting features. The customer support team is also responsive and helpful.
Software to engage both labelers and business lines in the necessary but tedious task of labeling and annotation, served by a dedicated team to listen to your problems.
Thanks to the fact that our AI infrastructure now includes Kili Technology, we can use the tool for all kinds of projects... LCL teams can accelerate drastically the creation of their training datasets, which means a significant improvement for all the parties involved.
With the choice of Kili, we are much more confident about the future. We decided to eliminate a large part of the technical debt by choosing a solution that will be perfectly mastered across a whole range of data science and AI projects.
FAQ

Need help?

Got questions about Kili Technology? Check out our FAQ. If you can't find it in this list, drop a question for our team.

What types of text annotation does Kili Technology support?
Can I pre-annotate text with my own model or an LLM?
Can Kili handle multilingual text annotation projects?
What quality controls does Kili provide for text annotation?
How does Kili support LLM evaluation and post-training?
What security measures does Kili have for confidential text data?
How many annotators can work together on text annotation projects?