Natural Language Processing
Text generation, transformers, embeddings, translation, and language understanding. The libraries, models, and frameworks behind modern LLMs — from Hugging Face Transformers and spaCy to LangChain, LlamaIndex, and the BERT/T5 model families.
Hugging Face Transformers
A library for state-of-the-art NLP models, used for text and vision tasks.
spaCy
Industrial-strength NLP library for Python, focusing on performance.
NLTK
Comprehensive library for symbolic and statistical NLP in Python.
DistilBERT
Lightweight version of BERT, efficient for AI text processing.
FastText
Library for efficient text classification and representation learning.
AllenNLP
NLP research library, built on PyTorch, for advanced AI text tasks.
Flair
Simple NLP library, focused on contextual string embeddings for AI.
Gensim
Library for topic modeling and document similarity analysis in AI.
NLPDataQuery
Natural language processing tool for querying and analyzing data using conversational language.
BERT
Bidirectional Encoder Representations from Transformers
RoBERTa
Robustly Optimized BERT Pretraining Approach
T5
Text-to-Text Transfer Transformer
BART
Bidirectional and Auto-Regressive Transformers
ALBERT
A Lite BERT for Self-supervised Learning of Language Representations
XLNet
Generalized Autoregressive Pretraining for Language Understanding
ELECTRA
Efficiently Learning an Encoder that Classifies Token Replacements Accurately
Mistral AI
Provider of state-of-the-art language models
LiteLLM
Lightweight library for working with LLMs
Cohere
Platform for building with language AI
DeepL
Neural machine translation service
Ollama
Run large language models locally
LangChain
Framework for developing applications powered by language models
LlamaIndex
Data framework for LLM applications
FlowiseAI
Visual tool for building LLM applications
25 tools in this category