Discussion
Loading...

Post

Log in
  • About
  • Code of conduct
  • Privacy
  • Users
  • Instances
  • About Bonfire
krakjoe
krakjoe
@krakjoe@phpc.social  ·  activity timestamp 2 months ago

Parallel GPT-2 inference in pure PHP, no python in sight:

> Snail are mysterious because they were once a closely guarded secret, but one thing is certain - they'll never leave.

Only an RTX 4060, no kv-cache ...

#php #ai #wisdom

Your browser does not support the video tag.
This video cannot be previewed
Open original
screencast of PHP doing GPT-2 inference with php-ort, and parallel extension
  • Copy link
  • Flag this post
  • Block

bonfire.cafe

A space for Bonfire maintainers and contributors to communicate

bonfire.cafe: About · Code of conduct · Privacy · Users · Instances
Bonfire social · 1.0.1 no JS en
Automatic federation enabled
Log in
  • Explore
  • About
  • Members
  • Code of Conduct