Goal
Implement HF Inference Provider as first-class provider (un-deletable) on Jan Model Provider list.
Background Information
Regarding Inference Provider
HF Inference Provider allow you to choose which specific provider you want through their client library. However, if we choose to their OpenAI-compatible version (which require much less effort on Jan's side), the provider is automatically selected on the server-side. resource
This means a few things:
If we choose OpenAI API (which Victor has already implemented, the work is more or less done)
Yuuki Huy changed 23 days agoView mode Like Bookmark
Goal 1: Partners should understand where we are headedNvidia
Microsoft
ARM
Huggingface
Goal 2: Community should understand where we are going
Shared on r/localllama
Amplified by our partners
dan-jan changed 2 months agoView mode Like 1 Bookmark
Check on Discord + Github for support in the morning for overview and proper tagging
Send out a daily debrief meeting with Nicole
Read through everyon ticket for yesterday to refresh on work load and directionRequest for update from anyone who has not updated their ticket prior to standup yet
Stand-up
Request ticket number for what are going to be worked on today
Ask for what was done yesterday
Ask for what is goint to be done today
Keep everything short
Yuuki Huy changed 2 months agoView mode Like Bookmark
Goal
Targeted at Developers
Marks Menlo's transition to a more OpenAI-like lab
Key Points
Menlo is an AI R&D Lab
We are not different from OpenAI and other foundational labs
We train models and make them available via API through our Menlo Platform
Menlo Platform
dan-jan changed 2 months agoView mode Like Bookmark
Get original QA checklist here: https://hackmd.io/@janhq/SJO9kXpJ1x
Release Version: v0.5.8
A. Installation, Update, and Uninstallation
1. Users Install App (New User Flow)
[ ] Installation package passes all security checks.
[ ] App launches successfully after installation.
2. Users Update App (Existing User Flow)
[ ] Validate that the update does not corrupt user data or settings.
Louis Le changed 6 months agoView mode Like Bookmark
Extensions are modular components that add functionality to Jan. Each extension is designed to handle specific features. Extensions can be managed through the Extensions page in settings.
Core Extensions
Cortex.cpp (v1.0.0)
The primary extension that manages both local and remote inference capabilities:
Local Engines
Llama.cpp: Fast, efficient local inference engine for GGUF models
Remote Engines
Ashley changed 7 months agoView mode Like Bookmark
Recipe based: pretraining, instruct tuning, etc.
Tightly integrated with HF
Suggest training templates
Strategy
Build the API & CLI first
Don't take on any data engineering/janitorial tasks
Tight integrations with HF
Magical features
Nicole Zhu changed 10 months agoView mode Like Bookmark
Research
Potential message:
Hey, Dan/I have been discussing company directions, and we want to take a bet on a being a frontier research team. Specifically around
It's very rare for smart & driven folks to collide on the same problem space.
What would it take for you to join Homebrew fulltime? What is your concrete ask, across ESOP and cash, so we can evaluate if we are in the same stratosphere?
find people to collide into a problem space.
Nicole Zhu changed 10 months agoView mode Like Bookmark
Present interesting questions.
Having interesting problems.
They need to show metrics: grant applications ask about industrial setting, graduate students, contacts into industry.
Tenure track have to show results faster.
It's not interesting problems
Tenured, have to deliver
PHDs have to show entirely new results
Nicole Zhu changed 10 months agoView mode Like Bookmark
Release Version: v0.5.3
Operating System: MacOS
A. Installation, Update, and Uninstallation
1. Users install app (New user flow)
[ ] :rocket: Installation package is not corrupted and passes all security checks.
[ ] :key: App launches successfully after installation.
2. Users update app (Existing user flow)
Phase 1: Planning
Definition of Ready (DoR):
[ ] Scope Defined: The features to be implemented are clearly defined and scoped out.
[ ] Requirements Gathered: Gather and document all the necessary requirements for the feature.
[ ] Stakeholder Input: Ensure relevant stakeholders have provided input on the document scope and content.
Definition of Done (DoD):
[ ] Document Complete: All sections of the document are filled out with relevant information.
[ ] Reviewed by Stakeholders: The document has been reviewed and approved by stakeholders.
[ ] Ready for Development: The document is in a state where developers can use it to begin implementation.
Van Pham changed a year agoEdit mode Like Bookmark
Release Version: v0.5.3
Operating System: Windows
A. Installation, Update, and Uninstallation
1. Users install app (New user flow)
[ ] :rocket: Installation package is not corrupted and passes all security checks.
[ ] :key: App launches successfully after installation.
2. Users update app (Existing user flow)
Van Pham changed a year agoEdit mode Like Bookmark
Release Version: backup
Operating System: MacOS
A. Installation, Update, and Uninstallation
1. Users install app (New user flow)
[x] Check that the installation package is not corrupted and passes all security checks.
[x] :key: Confirm that the app launches successfully after installation.
2. Users update app (Existing user flow)
Van Pham changed a year agoView mode Like Bookmark