Crunchyroll Logo

Crunchyroll

LLM Engineer III

Job Posted 10 Days Ago Posted 10 Days Ago
Be an Early Applicant
Hybrid
Hyderabad, Telangana
Senior level
Hybrid
Hyderabad, Telangana
Senior level
Architect and implement LLM applications, design pipelines, fine-tune models, develop APIs, and monitor LLM systems while collaborating with teams to integrate AI/ML capabilities.
The summary above was generated by AI
About Crunchyroll

Founded by fans, Crunchyroll delivers the art and culture of anime to a passionate community. We super-serve over 100 million anime and manga fans across 200+ countries and territories, and help them connect with the stories and characters they crave. Whether that experience is online or in-person, streaming video, theatrical, games, merchandise, events and more, it’s powered by the anime content we all love.

Join our team, and help us shape the future of anime!

About the Team

The R&D team is dedicated to developing, testing, and validating robust and scalable machine learning models that drive business objectives. Our focus includes enhancing operational processes through AI/ML solutions, such as trend analysis, anomaly detection, and the deployment of large language models (LLMs) for tasks like querying system health. Another major focus area is preserving, and improving customer experience and retention. We closely work with our stakeholders to ensure AI/ML objectives are clearly defined.

About the role

Crunchyroll is growing and changing, presenting unique challenges and opportunities to support millions of anime fans around the world. The AI/ML team provides seamless help to our internal stakeholders, ensuring an exceptional experience for all Crunchyroll fans.

  • Architect and implement end-to-end LLM-based applications, including chatbots, assistants, search agents, and knowledge discovery tools.
  • Design and deploy scalable RAG and GraphRAG pipelines using vector databases (e.g., Opensearch, Pinecone, Mongo) and document chunking strategies.
  • Fine-tune and optimize foundation models (e.g., Bedrock, Claude, Nova) for domain-specific use cases.
  • Own prompt design and evaluation - build prompt libraries and frameworks that enable rapid experimentation and reuse.
  • Develop APIs and microservices to serve LLM-based applications with real-time latency and uptime guarantees.
  • Collaborate with data, platform, and backend teams to integrate LLM capabilities into broader Crunchyroll product experiences.
  • Monitor and evaluate LLM systems in production for hallucination, latency, cost, and feedback loops.
  • Stay up to date with the latest in LLM research, tooling (LangChain, LlamaIndex), and ecosystem advancements.
About You

We get excited about candidates, like you, because...

  • Bachelor's or Master's degree in Computer Science, Machine Learning, AI, or a related field.
  • 5+ years of experience building production ML/AI systems, with 2+ years specifically focused on LLM applications.
  • Hands-on experience with production-ready RAG systems using tools like LangChain, LlamaIndex, or custom pipelines.
  • Hands-on experience with GraphRAG, LLMs, Graph and Vector Databases.
  • Deep understanding of prompt engineering, prompt templating, and prompt evaluation strategies.
  • Experience working with major foundation models (OpenAI, Anthropic, Nova, Bedrock etc.).
  • Familiarity with building semantic search systems and working with vector DBs at scale.
  • Strong backend/API development experience using TypeScript and knowledge of deploying services to cloud environments.
  • Python skills and experience working with AWS cloud platform and MLOps tools (e.g., AWS Bedrock, SageMaker, Databricks, Lambda, ECS/Fargate).
Why you will love working at Crunchyroll

In addition to getting to work with fun, passionate and inspired colleagues, you will also enjoy the following benefits and perks:

  • Best-in class medical, dental, and vision private insurance healthcare coverage
  • Access to counseling & mental health sessions 24/7 through our Employee Assistance Program (EAP)
  • Free premium access to Crunchyroll
  • Professional Development
  • Company's Paid Parental Leave
    • up to 26 weeks for birthing parents
    • up to 12 weeks for non-birthing parents
  • Hybrid Work Schedule
  • Paid Time Off
    • Flex Time Off
    • 5 Yasumi Days
    • Half-Day Fridays June - August
    • Winter Break
About our Values

We want to be everything for someone rather than something for everyone and we do this by living and modeling our values in all that we do. We value

  • Courage. We believe that when we overcome fear, we enable our best selves.

  • Curiosity. We are curious, which is the gateway to empathy, inclusion, and understanding.

  • Kaizen. We have a growth mindset committed to constant forward progress.
  • Service. We serve our community with humility, enabling joy and belonging for others.

Our commitment to diversity and inclusion

Our mission of helping people belong reflects our commitment to diversity & inclusion. It's just the way we do business.

We are an equal opportunity employer and value diversity at Crunchyroll. Pursuant to applicable law, we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

Crunchyroll, LLC is an independently operated joint venture between US-based Sony Pictures Entertainment, and Japan's Aniplex, a subsidiary of Sony Music Entertainment (Japan) Inc., both subsidiaries of Tokyo-based Sony Group Corporation.

Questions about Crunchyroll’s hiring process? Please check out our Hiring FAQs: https://help.crunchyroll.com/hc/en-us/articles/360040471712-Crunchyroll-Hiring-FAQs

Please refer to our Candidate Privacy Policy for more information about how we process your personal information, and your data protection rights: https://tbcdn.talentbrew.com/company/22978/v1_0/docs/spe-jobs-privacy-policy-update-for-crpa-dec-21-22.pdf

Please beware of recent scams to online job seekers. Those applying to our job openings will only be contacted directly from @crunchyroll.com email account.

Top Skills

Anthropic
AWS
Bedrock
Databricks
Ecs
Fargate
Lambda
Langchain
Llamaindex
Mongodb
Openai
Opensearch
Pinecone
Python
Sagemaker
Typescript

Similar Jobs at Crunchyroll

3 Days Ago
Hybrid
Hyderabad, Telangana, IND
Senior level
Senior level
Digital Media • eCommerce • Gaming • Mobile • News + Entertainment
The Staff Data Engineer at Crunchyroll will implement robust data infrastructure, mentor engineers, and improve data workflows in AWS and GCP environments.
Top Skills: AirflowAthenaAWSBigQueryClickhouseDruidEmrGCPGlueGoogle AnalyticsGoogle StorageGoogle Tag ManagerKinesisLambdaLookerPythonRedshiftS3SegmentSnowplowSparkSQLTableauTalend
3 Days Ago
Hybrid
Hyderabad, Telangana, IND
Senior level
Senior level
Digital Media • eCommerce • Gaming • Mobile • News + Entertainment
The Staff Software Engineer will design and develop backend microservices and frontend applications, ensuring data processing and insights delivery across teams.
Top Skills: Apache CamelAWSGCPJavaKafkaNoSQLReact
4 Days Ago
Hybrid
Hyderabad, Telangana, IND
Senior level
Senior level
Digital Media • eCommerce • Gaming • Mobile • News + Entertainment
The Senior Marketing Science Analyst will analyze campaign data, design analytics tools, collaborate with teams, and provide insights to enhance marketing strategies.
Top Skills: AdjustBranchBrazeGoogle AnalyticsMarketing Mix ModelingMulti-Touch AttributionSQLTableau

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account