All notable changes to transformers-php
will be documented in this file.
- Tensor Operations:
magnitude
,sqrt
andcosSimilarity
added. - Vips Binaries: - Vips binaries are now bundled by default, eliminating need to modify anything on the system to use libvips.
- Error Handling: - Adjusted error level to a warning for unknown model types, providing clearer feedback without interrupting the workflow.
- Dependencies: Reverted
rokka/vips
from dev back to normal dependencies. Since vips binaries are bundled by default, use of vips is now encouraged.
Full Changelog: https://github.com/CodeWithKyrian/transformers-php/compare/0.5.0...0.5.1
I'm excited to announce the latest version of TransformersPHP, packed with new features, improvements, and bug fixes. This release brings powerful enhancements to your machine-learning-driven PHP applications, enabling more efficient and versatile operations.
-
New Pipeline: Audio Classification - Easily classify audio clips with a pre-trained model.
$classifier = pipeline('audio-classification', 'Xenova/ast-finetuned-audioset-10-10-0.4593'); $audioUrl = __DIR__ . '/../sounds/cat_meow.wav'; $output = $classifier($audioUrl); // [ // [ // "label" => "Meow" // "score" => 0.6109990477562 // ] // ]
-
New Pipeline: Automatic Speech Recognition (ASR) - Supports models like
wav2vec
andwhisper
for transcribing speech to text. If a specific model is not officially supported, please open an issue with a feature request.- Example:
$transcriber = pipeline('asr', 'Xenova/whisper-tiny.en'); $audioUrl = __DIR__ . '/../sounds/preamble.wav'; $output = $transcriber($audioUrl, maxNewTokens: 256); // [ // "text" => "We, the people of the United States, ..." // ]
- Example:
-
Shared Libraries Dependencies: - A revamped workflow for downloading shared libraries dependencies ensures they are versioned correctly, reducing download sizes. These binaries are now thoroughly tested on Apple Silicon, Intel Macs, Linux x86_64, Linux aarch64, and Windows platforms.
-
Transformers::setup
Simplified -Transformers::setup()
is now optional. Default settings are automatically applied if not called. Theapply()
method is no longer necessary, but still available for backward compatibility. -
Immutable Image Utility - The Image utility class is now immutable. Each operation returns a new instance, allowing for method chaining and a more predictable workflow.
$image = Image::read($url); $resizedImage = $image->resize(100, 100); // $image remains unchanged
-
New Tensor Operations - New operations were added:
copyTo
,log
,exp
,pow
,sum
,reciprocal
,stdMean
. Additionally, overall performance improvements have been made to Tensor operations. -
TextStreamer Improvements - TextStreamer now prints to stdout by default. You can override this behavior using the
onStream(callable $callback)
method. Consequently, theStdoutStreamer
class is now obsolete. -
VIPS PHP Driver Update - The VIPS PHP driver is no longer bundled by default in
composer.json
. Detailed documentation is provided for installing the Vips PHP driver and setting up Vips on your machine. -
ONNX Runtime Upgrade - Upgraded to version 1.19.0, bringing more performance and compatibility with newer models.
-
Bug Fixes & Performance Improvements - Various bug fixes have been implemented to enhance stability and performance across the package.
I hope you enjoy these updates and improvements. If you encounter any issues or have any suggestions, please don’t hesitate to reach out through our Issue Tracker
Full Changelog: https://github.com/CodeWithKyrian/transformers-php/compare/0.4.4...0.5.0
- feat: add optional host argument for model download by @k99k5 in CodeWithKyrian#56
- @k99k5 made their first contribution in CodeWithKyrian#56
Full Changelog: https://github.com/CodeWithKyrian/transformers-php/compare/0.4.3...0.4.4
- Fix typo in docs by @BlackyDrum in CodeWithKyrian#42
- fix: statically calling FFI::new deprecated in PHP 8.3 by @CodeWithKyrian in CodeWithKyrian#48
- fix: improve regex for detecting language codes in NllbTokenizer by @CodeWithKyrian in CodeWithKyrian#49
- fix: digits pre-tokenizer returning empty array for text with no digits by @CodeWithKyrian in CodeWithKyrian#51
- feat: allow passing model filename when downloading a model from CLI
- fix: preTokenizer null error when there's no text pair](https://github.com/CodeWithKyrian/transformers-php/commit/901a049b8bd837c83d3edcd517dd76cf8e3ba6b9)
- feat: implement enforce size divisibility for image feature extractor by @CodeWithKyrian in CodeWithKyrian#53
- @BlackyDrum made their first contribution in CodeWithKyrian#42
Full Changelog: https://github.com/CodeWithKyrian/transformers-php/compare/0.4.2...0.4.3
- bugfix: Repository url resolution not working properly in Windows by @CodeWithKyrian in CodeWithKyrian#41
Full Changelog: https://github.com/CodeWithKyrian/transformers-php/compare/0.4.1...0.4.2
- configuration.md: fix indentation of Transformers::setup() by @k00ni in CodeWithKyrian#35
- PretrainedTokenizer::truncateHelper: prevent array_slice() error for flawed text input (summarization) by @k00ni in CodeWithKyrian#36
- Fix bug with Download CLI - use named parameters for model construct by @CodeWithKyrian in CodeWithKyrian#39
- @k00ni made their first contribution in CodeWithKyrian#35
Full Changelog: https://github.com/CodeWithKyrian/transformers-php/compare/0.4.0...0.4.1
- Add Qwen2 model support by @CodeWithKyrian in CodeWithKyrian#20
- Add chat input detection for text generation, and refactor streamer API. by @CodeWithKyrian in CodeWithKyrian#21
- bugfix: Fix error that occurs when streamer is not used by @CodeWithKyrian in CodeWithKyrian#22
- bugfix: Decoder sequence not calling the right method by @CodeWithKyrian in CodeWithKyrian#23
Full Changelog: https://github.com/CodeWithKyrian/transformers-php/compare/0.3.0...0.3.1
- Add Image Classification pipelines support by @CodeWithKyrian in CodeWithKyrian#9
- Add Zero shot Image Classification pipelines support by @CodeWithKyrian in CodeWithKyrian#9
- Add New Image Driver - VIPS by @CodeWithKyrian in CodeWithKyrian#10
- Add Object Detection Pipeline by @CodeWithKyrian in CodeWithKyrian#11
- Download ONNXRuntime automatically after composer install by @CodeWithKyrian in CodeWithKyrian#12
- Add Zero Shot Object Detection Pipeline and OwlVit models by @CodeWithKyrian in CodeWithKyrian#14
- Improve tensor performance by @CodeWithKyrian in CodeWithKyrian#13
- Set [MASK] usage in prompts for default Xenova/bert-base-uncased model by @takielias in CodeWithKyrian#15
- Add image feature extraction pipeline by @CodeWithKyrian in CodeWithKyrian#16
- Add image to image pipeline by @CodeWithKyrian in CodeWithKyrian#17
- bugfix: https slashes affected when joining paths by @CodeWithKyrian in CodeWithKyrian#19
- The install command no longer exists, as the required libraries are downloaded automatically on composer install.
- New Image driver configuration settings added that required either GD, Imagick or Vips
- @takielias made their first contribution in CodeWithKyrian#15
Full Changelog: https://github.com/CodeWithKyrian/transformers-php/compare/0.2.2...0.3.0
- bugfix: Fix the wrong argument being passed in Autotokenizer by @CodeWithKyrian in https://github.com/CodeWithKyrian/transformers-php/commit/05e55888d9ad0184103061347a427b259afb360e
- feat: cache tokenizer output to improve speed in repetitive tasks leading to 75% speed improvement (11.7687s to 2.9687s) by @CodeWithKyrian in https://github.com/CodeWithKyrian/transformers-php/commit/b115c28f526dfbde13457c00f5306d05a51c445b
Full Changelog: https://github.com/CodeWithKyrian/transformers-php/compare/0.2.1...0.2.2
- bugfix: Add symfony/console explicitly as a dependency by @CodeWithKyrian in CodeWithKyrian#7
- bugfix: Autoload errors for
WordPieceTokenizer
on case-sensitive operating systems in https://github.com/CodeWithKyrian/transformers-php/commit/0f1fc8bda91fb3df9492057a4224b171d2e3f2d5
Full Changelog: https://github.com/CodeWithKyrian/transformers-php/compare/0.2.0...0.2.1
- feat: Add ability to use chat templates in Text Generation by @CodeWithKyrian in CodeWithKyrian#1
- bugfix: Autoload errors for
PretrainedModel
on case-sensitive operating systems by @CodeWithKyrian in CodeWithKyrian#4 - feat: Bump OnnxRuntime PHP to 0.2.0 in https://github.com/CodeWithKyrian/transformers-php/commit/b3331623cf6696aacbbad0f8c33530086404424d
- feat: Improve download and install command interfaces to show progress bar in https://github.com/CodeWithKyrian/transformers-php/commit/b3331623cf6696aacbbad0f8c33530086404424d
Full Changelog: https://github.com/CodeWithKyrian/transformers-php/compare/0.1.0...0.2.0
We are thrilled to announce the launch of Transformers PHP, a groundbreaking library that brings the power of state-of-the-art machine learning to the PHP community. Inspired by the HuggingFace Transformers and Xenova Transformers.js, Transformers PHP aims to provide an easy-to-use, high-performance toolset for developers looking to integrate advanced NLP, and in future updates potentially more, capabilities into their PHP applications.
- Seamless Integration: Designed to be functionally equivalent to its Python counterpart, making the transition and usage straightforward for developers familiar with the original Transformers library.
- Performance Optimized: Utilizes ONNX Runtime for efficient model inference, ensuring high performance even in demanding scenarios.
- Comprehensive Model Support: Access to thousands of pre-trained models across 100+ languages, covering a wide range of tasks including text generation, summarization, translation, sentiment analysis, and more.
- Easy Model Conversion: With 🤗 Optimum, easily convert PyTorch or TensorFlow models to ONNX format for use with Transformers PHP.
- Developer Friendly: From installation to deployment, every aspect of Transformers PHP is designed with ease of use in mind, featuring extensive documentation and a streamlined API.
Installation is a breeze with Composer:
composer require codewithkyrian/transformers
And you must initialize the library to download neccesary libraries for ONNX
./vendor/bin/transformers install
For a comprehensive guide on how to use Transformers PHP, including detailed examples and configuration options, visit our documentation.
To ensure a smooth user experience, especially with larger models, we recommend pre-downloading models before deployment. Transformers PHP includes a handy CLI tool for this purpose:
./vendor/bin/transformers download <model_identifier>
This initial release lays the groundwork for a versatile machine learning toolkit within the PHP ecosystem. We are committed to continuous improvement and expansion of Transformers PHP, with future updates aimed at increasing supported tasks, enhancing functionality, and broadening the scope of models.
We encourage feedback, contributions, and discussions from the community. Whether you're reporting bugs, requesting features, or contributing code, your input is invaluable in making Transformers PHP better for everyone.
A huge thank you to Hugging Face for their incredible work on the Transformers library, to Xenova for inspiring this package, and to the broader machine learning community for their ongoing research and contributions. Transformers PHP stands on the shoulders of giants, and we are excited to see how it will empower PHP developers to push the boundaries of what's possible.