Skip to content

Commit

Permalink
chore: update primary readme with Baseten info
Browse files Browse the repository at this point in the history
  • Loading branch information
minaamshahid authored Oct 22, 2024
1 parent f6592a4 commit 1636b97
Showing 1 changed file with 12 additions and 0 deletions.
12 changes: 12 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -164,6 +164,18 @@ The library supports multiple inference backends to accommodate different hardwa
model = Llamafile()
```

4. **Baseten**:
- Remote execution.
- Improved concurrency patterns for larger workloads.
- Machine independent.

```python
from flow_judge import Baseten

model = Baseten()
```
For detailed information on using Baseten, visit the [Baseten readme](https://github.com/flowaicom/flow-judge/blob/feat/baseten-integration/flow_judge/models/adapters/baseten/README.md).

Choose the inference backend that best matches your hardware and performance requirements. The library provides a unified interface for all these options, making it easy to switch between them as needed.


Expand Down

0 comments on commit 1636b97

Please sign in to comment.