eKonomic Research Python Toolkit#

A NLP Library for Social Science Research#

PyPI Jupyter Book Badge PyPI - Downloads GitHub last commit LinkedIn Badge GitHub Repo stars GitHub followers

ekorpkit by ἐντελέχεια#

entelecheia 【en.te.lé.kʰeː.a】 is coined by Aristotle from ἐντελής (entelḗs, “complete, full, accomplished”) + ἔχειν (ékhein, “have, hold”). The term expresses the idea of a thing reaching its full potential or purpose. Similarly, ekorpkit 【iːkɔːkɪt】 aims to assist in completing and accomplishing projects by providing a flexible interface for NLP and ML research.

Introduction#

eKorpkit is a powerful software tool that helps facilitate natural language processing (NLP) and machine learning (ML) research by providing a flexible interface for various stages of a research pipeline, such as data extraction, preprocessing, training, and visualization. The use of the Hydra and pydantic libraries for configuration management and validation makes it more flexible and efficient to use. It also designed to be user-friendly, extensible and shareable.

As Artificial Intelligence (AI) becomes more advanced, it is essential to consider not just its technical capabilities but also its ethical and societal implications. In this context, the ancient Greek concept of entelecheia, coined by Aristotle, is particularly relevant. The term refers to the state of having achieved one’s full potential or the realization of one’s purpose. In the context of AI, entelecheia can be understood as the ability of these technologies to fully realize their potential and perform their intended functions in an optimal way.

eKorpkit is designed with the principles of entelecheia in mind. It allows NLP and ML researchers to design, implement, and evaluate their models in a way that takes into account the underlying principles of human intelligence, such as the ability to understand context, handle ambiguity, and adapt to changing conditions.

Key features#

Easy Configuration#

  • You can compose your configuration dynamically, enabling you to easily get the perfect configuration for each research.

  • You can override everything from the command line, which makes experimentation fast, and removes the need to maintain multiple similar configuration files.

  • With a help of the eKonf class, it is also easy to compose configurations in a jupyter notebook environment.

No Boilerplate#

  • eKorpkit lets you focus on the problem at hand instead of spending time on boilerplate code like command line flags, loading configuration files, logging etc.

Workflows#

  • A workflow is a configurable automated process that will run one or more jobs.

  • You can divide your research into several unit jobs (tasks), then combine those jobs into one workflow.

  • You can have multiple workflows, each of which can perform a different set of tasks.

Sharable and Reproducible#

  • With eKorpkit, you can easily share your datasets and models.

  • Sharing configs along with datasets and models makes every research reproducible.

  • You can share each unit jobs or an entire workflow.

Pluggable Architecture#

  • eKorpkit has a pluggable architecture, enabling it to combine with your own implementation.

Contents#