(Senior) Software Engineer - Compute Platform

Company: Prime Intellect, Inc.
Location: San Francisco
Posted on: January 16, 2025

Job Description:

Building the Future of Decentralized AI DevelopmentAt Prime Intellect, we're building the foundation for decentralized AI development at scale. Our platform combines powerful distributed training infrastructure with an intuitive developer experience, enabling researchers and engineers to train state-of-the-art models collaboratively. Fresh off our $5.5M seed round backed by industry leaders like Clement Delangue (HuggingFace) and Dylan Patel (SemiAnalysis), we're expanding our team to accelerate open-source AGI development.Role ImpactThis is a hybrid role spanning both our developer platform and infrastructure layers. You'll work on two key areas:1. Our developer-facing platform for AI workload management2. The underlying distributed infrastructure that powers our training systemsCore Technical ResponsibilitiesPlatform Development- Build intuitive web interfaces for AI workload management and monitoring- Develop REST APIs and backend services in Python- Create real-time monitoring and debugging tools- Implement user-facing features for resource management and job controlInfrastructure Development- Design and implement distributed training infrastructure in Rust- Build high-performance networking and coordination components- Create infrastructure automation pipelines with Ansible- Manage cloud resources and container orchestration- Implement scheduling systems for heterogeneous hardware (CPU, GPU, TPU)Technical RequirementsPlatform Skills- Strong Python backend development (FastAPI, async)- Modern frontend development (TypeScript, React/Next.js, Tailwind)- Experience building developer tools and dashboards- RESTful API design and implementationInfrastructure Skills- Systems programming experience with Rust- Infrastructure automation (Ansible, Terraform)- Container orchestration (Kubernetes)- Cloud platform expertise (GCP preferred)- Observability tools (Prometheus, Grafana)Nice to Have- Experience with GPU computing and ML infrastructure- Knowledge of AI/ML model architecture and training- High-performance networking implementation- Open-source infrastructure contributions- WebSocket/real-time systems experienceWhat We Offer- Competitive compensation with significant equity and token incentives- Flexible work arrangement (remote or San Francisco office)- Full visa sponsorship and relocation support- Professional development budget for courses and conferences- Regular team off-sites and conference attendance- Opportunity to shape the future of decentralized AI developmentGrowth OpportunityYou'll join a team of experienced engineers and researchers working on cutting-edge problems in AI infrastructure. We believe in open development and encourage team members to contribute to the broader AI community through research and open-source contributions.We value potential over perfection - if you're passionate about democratizing AI development and have experience in either platform or infrastructure development (ideally both), we want to talk to you.Ready to help shape the future of AI? Apply now and join us in our mission to make powerful AI models accessible to everyone.
#J-18808-Ljbffr

Keywords: Prime Intellect, Inc., San Jose , (Senior) Software Engineer - Compute Platform, IT / Software / Systems , San Francisco, California