eKonomic Research Python Toolkit#
A NLP Library for Social Science Research#
ekorpkit by ἐντελέχεια#
entelecheia 【en.te.lé.kʰeː.a】 is coined by Aristotle from ἐντελής (entelḗs, “complete, full, accomplished”) + ἔχειν (ékhein, “have, hold”). The term expresses the idea of a thing reaching its full potential or purpose. Similarly, ekorpkit 【iːkɔːkɪt】 aims to assist in completing and accomplishing projects by providing a flexible interface for NLP and ML research.
Introduction#
eKorpkit is a powerful software tool that helps facilitate natural language processing (NLP) and machine learning (ML) research by providing a flexible interface for various stages of a research pipeline, such as data extraction, preprocessing, training, and visualization. The use of the Hydra and pydantic libraries for configuration management and validation makes it more flexible and efficient to use. It also designed to be user-friendly, extensible and shareable.
As Artificial Intelligence (AI) becomes more advanced, it is essential to consider not just its technical capabilities but also its ethical and societal implications. In this context, the ancient Greek concept of entelecheia, coined by Aristotle, is particularly relevant. The term refers to the state of having achieved one’s full potential or the realization of one’s purpose. In the context of AI, entelecheia can be understood as the ability of these technologies to fully realize their potential and perform their intended functions in an optimal way.
eKorpkit is designed with the principles of entelecheia in mind. It allows NLP and ML researchers to design, implement, and evaluate their models in a way that takes into account the underlying principles of human intelligence, such as the ability to understand context, handle ambiguity, and adapt to changing conditions.
Key features#
Easy Configuration#
You can compose your configuration dynamically, enabling you to easily get the perfect configuration for each research.
You can override everything from the command line, which makes experimentation fast, and removes the need to maintain multiple similar configuration files.
With a help of the eKonf class, it is also easy to compose configurations in a jupyter notebook environment.
No Boilerplate#
eKorpkit lets you focus on the problem at hand instead of spending time on boilerplate code like command line flags, loading configuration files, logging etc.
Workflows#
A workflow is a configurable automated process that will run one or more jobs.
You can divide your research into several unit jobs (tasks), then combine those jobs into one workflow.
You can have multiple workflows, each of which can perform a different set of tasks.
Pluggable Architecture#
eKorpkit has a pluggable architecture, enabling it to combine with your own implementation.
Contents#
Tutorials
Datasets
Research
Lectures
- Introduction to NLP
- Introduction
- Getting started with ekorpkit
- Research Applications
- Language Models
- Topic Modeling
- Topic Models
- Topic Coherence Measures
- Sentiment Analysis
- Tokenization
- Word Segmentation and Association
- Vector Semantics and Representation
- Word Embeddings
- Lab 1: Preparing Wikipedia Corpora
- Lab 2: EDA on Corpora
- Deep Learning for NLP
- Introduction
- Getting started with ekorpkit
- Zero Shot, Prompt, and Search Strategies
- What is BLOOM?
- Bloom Examples
- Transformers
- BERT: Bidirectional Encoder Representations from Transformers
- T5: Text-To-Text Transfer Transformer
- Tokenization
- SentencePiece Tokenizer
- ByT5: Towards a token-free future with pre-trained byte-to-byte models
- Pretrained Language Models
- Lab 1: Preparing Wikipedia Corpora
- Lab 2: EDA on Corpora
- Lab 3: Training Tokenizers
- Lab 4: Pretraining Language Models
- NLP Applications
- AI Art (Text-to-Image)
- Machine Learning Systems Design
- Data Science for Economics and Finance
Projects