codegen-llm

This project focuses on fine-tuning a large language model (LLM) for code generation. It leverages state-of-the-art models and techniques to generate code based on natural language prompts.

Project Structure

src/: Contains the main source code for the project.
- data_prep.py: Handles data loading and preprocessing.
- train.py: Script for training the model.
- utils.py: Utility functions.
notebooks/: Jupyter notebooks for exploration and experimentation.
requirements.txt: Lists the project dependencies.

Getting Started

Installation:
```
pip install -r requirements.txt
```
Usage: Please open the Jupyter Notebook / Google Colab.

Dataset

The Stack: https://huggingface.co/datasets/bigcode/the-stack

Model

salesforce/codegen-350m-multi

Contact

Feel free to contact me through my GitHub or through my UpWork profile.