Skip to content

Welcome to Transformer-PyTorch-Chatbot, your go-to repository for building state-of-the-art chatbots using PyTorch and the Transformer architecture. This repository provides a comprehensive framework and implementation guide for leveraging the power of Transformers to create conversational AI systems from scratch.

License

Notifications You must be signed in to change notification settings

rafipatel/transformer-pytorch-chatbot

Repository files navigation

Chatbot Project

This repository contains the coursework for INM706, focused on the design and development of an intelligent chatbot using modern Natural Language Processing (NLP) techniques.

The project employs Seq2Seq and Transformer architectures, enhanced with attention mechanisms to enable the chatbot to conduct coherent and contextually relevant conversations. Applications of this chatbot span various sectors, including customer service, healthcare, and education.

Repository Structure

  • seq2seq/ or transformer/: Contains all source code for the project.
  • data/: Directory for datasets used, including links to external sources.
  • model_name/train.py: To train the model.

Installation

To set up the project environment to run the code, follow these steps:

git clone https://github.com/rafipatel/transformer-pytorch-chatbot.git
cd transformer-pytorch-chatbot
pip install -r requirements.txt

Usage

  • Change the directory to desired model (either Seq2Seq or Transformer) To train the chatbot model, run:
python train.py

To interact with the trained chatbot, run:

python conversations.py

Datasets

The chatbot is trained on the Cornell Movie-Dialogs Corpus. The dataset can be accessed through the following link:

Models

The project includes two main types of models:

  • Seq2Seq Model: A sequence-to-sequence model with optional attention mechanisms.
  • Transformer Model: Utilizes multi-head attention to improve the understanding of context.

Checkpoints

Contributing

Contributions to this project are welcome. Please fork the repository and submit a pull request with your enhancements.

License

This project is licensed under the MIT License - see the LICENSE file for details.

Acknowledgments

Thank you to the instructors and peers for their guidance and feedback throughout this coursework.

About

Welcome to Transformer-PyTorch-Chatbot, your go-to repository for building state-of-the-art chatbots using PyTorch and the Transformer architecture. This repository provides a comprehensive framework and implementation guide for leveraging the power of Transformers to create conversational AI systems from scratch.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published