Skip to main content
Together AI SignalsBack to the read

Every source behind the read

Every source GILD analyzed, newest first. Each says who the source is, how it knows, whether it still applies and which findings it counts toward. Open a count to see only its sources.

Whose sources count

Source

46 sources in All practitioners, with product documentation Showing all 46 sources

  1. Mixed

    Opposite-Cup2850, Reddit (r/SillyTavernAI)

    Provider question (GLM 5.3 Flash)Reddit post, r/SillyTavernAI

    Together and Venice give 2-3x the tokens per second of Z.AI for GLM-5.3-Flash at the same price, and the poster asks whether they run a lower quant, since neither lists one.

    Published Oct 28, 2026self-described: Choosing a host for GLM-5.3-Flash in SillyTavern

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Current
    Observed on
    GLM-5.3-Flash on Together, Venice and Z.AI
  2. Negative

    Sam Mirazi, data scientist and founder of BrAIN

    Same model, two services: gpt-oss-120b on Cerebras and Together (speed)Personal blog post, advisee.substack.com

    Sam Mirazi called gpt-oss-120b on Together and Cerebras 20 times each with a prompt of about 4,460 tokens: a typical long-document answer finished in 0.42 seconds on Cerebras against 2.0 seconds on Together. Every request returned HTTP 200.

    Published Oct 25, 2026self-described: His own test of gpt-oss-120b on two paid API accounts, 20 runs per service per test

    Published on
    Practitioner Blogs & Reviews
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Current
    Observed on
    gpt-oss-120b on Together and on Cerebras
  3. Positive

    Sam Mirazi, data scientist and founder of BrAIN

    Same model, two services: gpt-oss-120b on Cerebras and Together (cost)Personal blog post, advisee.substack.com

    At published prices on October 24, 2026, Sam Mirazi's typical long-prompt run of gpt-oss-120b cost US$0.00177 on Cerebras against US$0.00083 on Together, so Cerebras cost about 2.1 times as much.

    Published Oct 25, 2026self-described: The same test, priced at each service's published rates on October 24, 2026

    Published on
    Practitioner Blogs & Reviews
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Current
    Observed on
    gpt-oss-120b on Together and on Cerebras
  4. Mixed

    Josh Heitzman (joshheitzman), software engineer and creator of the FluxImp agent harness

    Hacker News comment recommending DeepSeek V4.1 Flash from together.aiHacker News comment

    Recommends DeepSeek V4.1 Flash from together.ai, not the 1017 build. DeepInfra is cheaper for that model but noticeably slower, and they say the inference from together.ai feels like it might be better, not quantified.

    Published Oct 23, 2026self-described: Choosing a host for DeepSeek V4.1 Flash as a coding model, after open-sourcing their harness

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Current
    Observed on
    DeepSeek V4.1 Flash on together.ai and on DeepInfra
  5. Mixed

    karan R., G2 reviewer

    G2 review of Together AI on AWS Marketplace by karan R.G2 review on AWS Marketplace

    Praises Together's latency and quick access to newly launched models for voice agents, still below Cerebras. The API's requests-per-minute limit is harming their business: their traffic comes in bursts, and at peak times they run into 429 errors.

    Published Oct 21, 2026self-described: Builds voice agents for businesses on their own platform

    Published on
    Practitioner Blogs & Reviews
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Current
  6. Mixed

    Muhammad Basit J., G2 reviewer

    G2 review of Together AI on AWS Marketplace by Muhammad Basit J.G2 review on AWS Marketplace

    Finds the dashboard clean and the API straightforward to integrate, but new accounts are placed into read-only mode and need an upfront credit deposit before running test prompts in the playground.

    Published Oct 21, 2026self-described: A developer testing the platform's playground and API

    Published on
    Practitioner Blogs & Reviews
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Current
  7. Positive

    zzzeek, creator of SQLAlchemy, Alembic Migrations, dogpile.cache and Mako Templates

    Hacker News comment on GLM-5.3 on together.ai as a second reviewerHacker News comment

    When they have to think about tokens they use together.ai with an open-weight model such as GLM-5.3, which they sometimes use to review a Claude change. They find GLM 5.x very chatty.

    Published Oct 4, 2026self-described: An open-source maintainer on a Claude Max subscription who uses open models when tokens matter

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Current
    Observed on
    GLM-5.3 on together.ai
  8. Negative

    Josh Heitzman (joshheitzman), software engineer and creator of the FluxImp agent harness

    Hacker News comment on running DeepSeek-V4-Flash-0731 through Kilo Code and his own harnessHacker News comment

    With DeepSeek-V4-Flash-0731 on together.ai, Kilo Code had a lot of trouble making successful edits, while the same model used the tools of their own harness just fine. On DeepInfra the two harnesses showed little difference.

    Published Sep 17, 2026self-described: Benchmarking open-weight models across hosts with Kilo Code and an agent harness of their own

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Current
    Observed on
    DeepSeek-V4-Flash-0731 on together.ai with Kilo Code
  9. Negative

    GT95, Reddit (r/openrouter)

    OpenRouter keeps routing calls to failing providerReddit post, r/openrouter

    Running DeepSeek V4.1 Flash through OpenRouter in the Hermes agent, the work stopped several times with API call failed after 3 retries: Upstream error from Together: Stream error: h2 protocol error.

    Published Sep 13, 2026self-described: A system administration task in the Hermes agent, routed by OpenRouter

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Current
    Observed on
    DeepSeek V4.1 Flash routed by OpenRouter to Together
  10. Negative

    Nils Durner (ndr_), technologist in generative AI, security and privacy, author of arXiv:2510.01259

    Hacker News comment on noisy hosted results in gpt-oss red-teamingHacker News comment

    For their gpt-oss red-teaming paper they first used OpenRouter with DeepInfra and Together AI. The results were much too noisy to draw reliable conclusions, so they rented GPUs through vast.ai and ran the model themselves with vLLM.

    Published Sep 12, 2026self-described: Red-teaming research for OpenAI's gpt-oss competition, published as arXiv:2510.01259

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Current
    Observed on
    OpenRouter with DeepInfra and Together AI
  11. Negative

    Mo Moustafa, AI Product Engineer for Startups, runs Olly

    So you want to use OpenRouter? (hollow completions)Engineering blog post, mmoustafa.com

    Running Olly on open models through OpenRouter, he saw one host return 200 responses with null content, null reasoning and no usage object in July 2026, and a month later Together did the same on the DeepSeek 0731 checkpoint.

    Published Sep 7, 2026self-described: Olly, an iMessage assistant on open models through OpenRouter

    Published on
    Practitioner Blogs & Reviews
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Current
    Observed on
    DeepSeek V4 Flash 0731 on Together's endpoint through OpenRouter
  12. Negative

    Mo Moustafa, AI Product Engineer for Startups, runs Olly

    So you want to use OpenRouter? (image input by host)Engineering blog post, mmoustafa.com

    In his per-host test of MiniMax M3 with small image tasks, dated July 31, 2026, Venice and Together did not see the MiniMax images at all, while the other hosts did.

    Published Sep 7, 2026self-described: Olly, an iMessage assistant on open models through OpenRouter, testing image input per host

    Published on
    Practitioner Blogs & Reviews
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Current
    Observed on
    MiniMax M3 on Together's endpoint through OpenRouter
  13. Mixed

    Peter Sugihara (rgbrgb), co-founder of Open Listings

    Hacker News comment on GLM-5.3-Flash via together.ai against DeepSeek V4 FlashHacker News comment

    Peter Sugihara tested GLM-5.3-Flash via together.ai against DeepSeek V4 Flash on ten ad-detection tasks: GLM cost US$0.0242 against US$0.0235 and took 108 seconds in total against 154 seconds. Sugihara kept DeepSeek because latency was not critical.

    Published Aug 28, 2026self-described: A personal ad-detection task over written transcripts, ten tasks per run

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Current
    Observed on
    zai-org/GLM-5.3-Flash via together.ai
  14. Positive

    dkersten, Hacker News

    Hacker News comment on a mixture of open-weight models through Together.ai and Fireworks.aiHacker News comment

    Has mostly settled on a mixture of open-weight models through Together.ai and Fireworks.ai, a MiniMax subscription for high-token tasks, and Codex for the occasional complex task.

    Published Aug 24, 2026self-described: Their own coding work, after leaving a closed-model service they call unreliable

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Current
    Observed on
    Open-weight models through Together.ai and Fireworks.ai
  15. Positive

    joecot, Hacker News

    Hacker News comment on running new Chinese models on US providersHacker News comment

    Sticks with OpenCode Zen, which uses only US providers, and Together.ai, which hosts models itself, and waits until new Chinese models are open source and on US providers.

    Published Jul 20, 2026self-described: Choosing where to run newly released open-weight models

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Current
  16. Negative

    Evening-Guarantee-84, Reddit (r/openrouter)

    Reply on OpenRouter billing compared with together.ai refundsReddit comment, r/openrouter

    Says together.ai won't refund unused credit even though they haven't been to the site in months, against OpenRouter refunding a duplicate purchase instantly.

    Published Jul 19, 2026self-described: Prepaid credit left unused on Together

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Current
  17. Negative

    Max Collier (mcwalrus), software engineer, entain-group on his GitHub profile

    Mark 6 removed Together.ai serverless models as deprecatedGitHub issue, anomalyco/models.dev

    Six together.ai models, among them zai-org/GLM-5.1, zai-org/GLM-5 and Qwen/Qwen3.5-397B-A17B, still appeared as active in the models.dev catalog but were no longer served on the serverless endpoint, with a curl loop against api.together.ai to reproduce it.

    Published Jul 18, 2026self-described: Checking the models.dev catalog against Together's serverless endpoint

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Current
    Observed on
    Together serverless endpoint at api.together.ai
  18. Negative

    Max Collier (mcwalrus), software engineer, entain-group on his GitHub profile

    Together.ai models to be deprecated July 10GitHub issue, earendil-works/pi

    Together.ai's notice emails say it is deprecating zai-org/GLM-5.1 and Qwen3-235B-A22B-Instruct-2507-tput on July 10, 2026, and the issue notes that GLM-5.1 will have no upgrade path. Of the two replacements the emails recommend, GLM-5.2 was not yet supported in pi.

    Published Jun 28, 2026self-described: Keeping the pi coding agent's Together model list current

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Current
    Observed on
    zai-org/GLM-5.1 and Qwen3-235B-A22B-Instruct-2507-tput on Together
  19. Negative

    Eric Henry (awakenalive), TrueVektor Development

    Together.ai MiniMaxAI/MiniMax-M2.5 model doesn't work with serverless inferenceGitHub issue, earendil-works/pi

    Every message to MiniMaxAI/MiniMax-M2.5 returned Together's Error: 400 Unable to access non-serverless model, with a link to create and start a dedicated endpoint for the model.

    Published Jun 8, 2026self-described: Selecting a Together model in the pi coding agent on pay-per-token serverless

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Current
    Observed on
    MiniMaxAI/MiniMax-M2.5 on Together serverless
  20. Negative

    Branko Radovanović (brankoradovanovic-mcom), Multicom d.o.o.

    bug: max_output_tokens setting doesn't work with Together.aiGitHub issue, janhq/jan

    In Jan, every prompt to Together.ai with a Max Output Tokens value fails with Bad Request, whatever the value, while other parameters work. His own diagnosis is that Together.ai doesn't expect the parameter and rejects the request.

    Published Jun 3, 2026self-described: The Jan desktop client with Together.ai as its remote provider

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Current
    Observed on
    Together.ai through the Jan client
  21. Negative

    HDBaseT, Hacker News

    Hacker News comment on together.ai outages and latencyHacker News comment

    One commenter's impression that together.ai seems fairly unreliable, with constant outages or higher than normal latency. The comment states no use of their own.

    Published May 19, 2026self-described: An aside in a thread about open-model hosts

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Current
  22. Mixed

    pants2, Hacker News

    Hacker News comment on Together.ai's price against DeepSeek's own APIHacker News comment

    Calls Together.ai a good US provider, but says it is 15X more expensive than DeepSeek's Chinese-subsidized pricing. A reply in the same thread says most US infra providers are about 5x more expensive, not 15x.

    Published May 11, 2026self-described: Weighing US hosts against DeepSeek's first-party pricing

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Current
  23. Negative

    Santiago Martinez Bragado (smartinezbragado), Traza

    Release a langchain-together 1.0 without dependency conflictsGitHub issue, langchain-ai/langchain-together

    langchain-together 0.3.x pinned langchain-openai below 0.4, so Traza's workspace could not resolve once it needed langchain-openai 1.1. The package in the langchain-ai organization lagged LangChain 1.x, and he asked for a 1.0 release.

    Published Mar 24, 2026self-described: Traza's workspace on LangChain 1.x

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Current
    Observed on
    langchain-together 0.3.x
  24. Positive

    slippery, builder of Ephemeral, an open-source chat app built on Together

    Ephemeral chat. Private, secure, chat with together.ai open source models.Reddit post, r/LocalLLaMA

    Built Ephemeral, a private chat app on Together's Kimi-K2.5. The app logs nothing locally, and with the correct settings at together.ai you can enable Zero Data Retention, so inference happens in memory and is then gone.

    Published Feb 7, 2026self-described: Ephemeral, their open-source web chat app on Together's Kimi-K2.5

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Current
    Observed on
    Kimi-K2.5 on together.ai with Zero Data Retention
  25. Negative

    Juan Pedro Michelini Jorge (juanmichelini), MTS @ Openhands: Evals, benchmarks, leaderboards, harness

    Change model qwen/qwen3-coder-next from together.ai to openrouterGitHub issue, OpenHands/software-agent-sdk

    The OpenHands evals team tried Qwen3-Coder-Next through LiteLLM's together_ai route and got LiteLLM's error that the model provided by together.ai does not support tools, so the team moved the model to OpenRouter.

    Published Feb 4, 2026self-described: The OpenHands agent SDK's evaluation runs, calling models through LiteLLM

    Published on
    Developer Communities
    Who
    Product or platform team
    Evidence
    Reported
    Applies to
    Current
    Observed on
    Qwen3-Coder-Next through LiteLLM's together_ai route
  26. Negative

    Roman Vashurin (rvashurin), research engineer at MBZUAI

    seed must not be set when best_of is greater than 1GitHub issue, togethercomputer/together-python

    Asking Together's chat API for several completions with a seed set returned an input validation error: seed must not be set when best_of is greater than 1.

    Published Jan 16, 2026self-described: Uncertainty-quantification research that needs several seeded completions per prompt

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Current
    Observed on
    chat.completions.create on Together
  27. Negative

    Infamous_Sector_6411, Reddit (r/LocalLLaMA)

    Having a problem with the together.ai apiReddit post, r/LocalLLaMA

    Bought €15 of Together credits to power AnythingLLM. Whenever they try a more complex prompt the model abruptly stops, the same through the aichat CLI, with max_tokens set high, and they ask whether OpenRouter would have been the better pick.

    Published Oct 19, 2025self-described: Personal projects on AnythingLLM, with €15 of Together credits

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Still applicable
    Observed on
    Together API through AnythingLLM and the aichat CLI
  28. Positive

    abnormal_human, Reddit (r/LocalLLaMA)

    Reply on truncated answers from the together.ai apiReddit comment, r/LocalLLaMA

    abnormal_human says they have pushed more than 1 billion tokens (1B+ tokens) through Together across all kinds of use cases without running into the cut-off answers, and does not think the API is broken.

    Published Oct 19, 2025self-described: Replying in the same thread from their own usage across many use cases

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Still applicable
    Observed on
    Together API
  29. Negative

    wleonie, collaborator on debatelab/evidence-seeker

    Fix access to Llama-3.3-70B-Instruct modelGitHub issue, debatelab/evidence-seeker

    Llama-3.3-70B-Instruct, with Together.ai as the inference provider, returned a 422 error, grammar is not valid: failed to compile grammar, at four steps of the evidence-seeker workflow.

    Published Sep 18, 2025self-described: A multi-step evidence-checking pipeline that uses grammar-constrained output

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Still applicable
    Observed on
    meta-llama/Llama-3.3-70B-Instruct with Together.ai as inference provider
  30. Negative

    David Else (David-Else), software developer, Else Web Development

    Agent seems unable to do anything using together.aiGitHub issue comment, anomalyco/opencode

    With Qwen3 Coder and Kimi K2 on together.ai, the opencode agent said it would act and then did nothing, and DeepSeek R1 returned raw tool-call tokens. An opencode contributor thought Together was not parsing out tool calls in a compatible manner, and he asked for another host.

    Published Aug 22, 2025self-described: The opencode coding agent on Together-hosted open models, with no proxy

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Still applicable
    Observed on
    Qwen3 Coder, Kimi K2, DeepSeek V3 and DeepSeek R1 on together.ai in opencode
  31. Negative

    Sagar (sagar-catomz), GitHub

    Cannot use GPT-OSS-120b with ChatTogether and tools for create_react_agentGitHub issue, langchain-ai/langchain-together

    create_react_agent with ChatTogether on gpt-oss-120b works without tools, and once tools are added it fails with a 400 error, The decoder prompt cannot be empty.

    Published Aug 20, 2025self-described: A LangGraph ReAct agent on ChatTogether

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Still applicable
    Observed on
    gpt-oss-120b through ChatTogether
  32. Negative

    Amritanshu Barpanda (ABarpanda), aspiring AI engineer, Advanced Engineering Hire intern at Accenture Pune from May to July 2026

    Use alternative of TogetherAIGitHub issue, ABarpanda/Animegen

    His Animegen code generates images with the black-forest-labs/FLUX.1-schnell-Free model from TogetherAI. The free credits are limited, so the issue asks for ways to run it freely on a cloud or rented GPU.

    Published Jul 19, 2025self-described: Animegen, his image-generation project, on Together's free FLUX model

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Still applicable
    Observed on
    black-forest-labs/FLUX.1-schnell-Free on TogetherAI
  33. Negative

    Wild_King_1035, Reddit (r/LocalLLaMA)

    Got Out of Credits Email from Together AI While Only Using Free Model and Still Have $1 in BalanceReddit post, r/LocalLLaMA

    After about a month of using only the free llama-3-70b-instruct-turbo-free model in their app, they got an email saying their Together AI account had run out of credits and access is paused at zero, while their dashboard still showed a US$1 balance.

    Published Jul 16, 2025self-described: An app calling the free llama-3-70b-instruct-turbo-free model through the Together API for about a month

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Still applicable
    Observed on
    llama-3-70b-instruct-turbo-free through the Together API
  34. Mixed

    impure, Hacker News

    Hacker News comment on Gemma E4B on together.aiHacker News comment

    impure has been trying Gemma E4B on together.ai: it takes 10x as long as Gemini 2.5 Flash Lite and is weak at multilingual, but it produces acceptable results and is way cheaper.

    Published Jul 3, 2025self-described: Trying a small open model on together.ai against Gemini 2.5 Flash Lite

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Still applicable
    Observed on
    Gemma E4B on together.ai
  35. Negative

    Jarett (JarettForzano), Vals AI

    Llama 4 Scout on together_ai returns tool calls in the message textGitHub issue, BerriAI/litellm

    LiteLLM's model list says Llama 4 Scout supports tool calling, but on together_ai the tool call came back as text inside the message content, with tool_calls empty, and he believed it was consistent. Another commenter called it a Together bug.

    Published Jun 5, 2025self-described: A tool-using agent calling Together through LiteLLM

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Still applicable
    Observed on
    Llama 4 Scout (Llama-4-Scout-17B-16E-Instruct) on together_ai through LiteLLM
  36. Negative

    Matthias Geihs (matthiasgeihs), cryptography engineer and systems architect at Consensys

    The together library adds over 100MB of dependenciesGitHub issue, togethercomputer/together-python

    Matthias Geihs found that adding the together library added over 100MB in dependencies after his small shared VMs ran out of memory, and replaced it with a REST call. In February 2026 a Together contributor said the 2.0 SDK should be much smaller.

    Published Jun 3, 2025self-described: Calling Together from small shared test VMs

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Still applicable
    Observed on
    together Python SDK 1.x
  37. Negative

    Venkat (venkatasg), assistant professor of computer science at Ithaca College

    Unclosed client session errors from the async client after a few batch callsGitHub issue, togethercomputer/together-python

    On Build tier 3, having spent US$100, Venkat kept hitting unclosed client session errors after only a couple of batch calls with the async client. In February 2026 a Together contributor said its 2.0 SDK reworks the HTTP client and should solve the issue.

    Published Apr 17, 2025self-described: Research batches of DeepSeek-V3 calls on Build tier 3

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Still applicable
    Observed on
    together Python SDK 1.x async client with DeepSeek-V3
  38. Negative

    Steve Cosman (scosman), building Kiln (kiln.tech), formerly Apple Photos AI

    Remove the pyarrow dependency from the together Python SDKGitHub issue, togethercomputer/together-python

    Steve Cosman found the together Python SDK required pyarrow, which he says is about 80MB, for a parquet check most users never need, and asked for it to be removed.

    Published Mar 19, 2025self-described: Shipping Kiln, an app that bundles model-provider SDKs

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Still applicable
    Observed on
    together Python SDK 1.x
  39. Mixed

    Carl Silva (silvacarl2), Sphinx Medical Technologies

    together fine-tuning list crashes with a validation errorGitHub issue, togethercomputer/together-python

    together fine-tuning list crashed with a pydantic validation error on the data the API returned. Two days later a Together contributor said it was a bug in the API, now resolved with no client update, and he replied that their stuff rocks.

    Published Feb 2, 2025self-described: Managing fine-tuning jobs from Together's command-line client

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Still applicable
    Observed on
    together fine-tuning list
  40. Negative

    Shivanshu Gupta (Shivanshu-Gupta), NLP and AI researcher, Adobe on his GitHub profile

    JSON mode on Llama 3.1 and 3.3 70B Turbo returns invalid JSONGitHub issue, togethercomputer/together-python

    With JSON mode on Meta-Llama-3.1-70B-Instruct-Turbo and Llama-3.3-70B-Instruct-Turbo, the model regularly failed to produce valid JSON, often adding random tokens toward the end. A Together contributor said the issue was with the API and asked him to open a support ticket.

    Published Jan 8, 2025self-described: Generating structured agent traces on Together's serverless Llama 70B Turbo models

    Published on
    Developer Communities
    Who
    Individual builder
    Evidence
    Reported
    Applies to
    Still applicable
    Observed on
    Meta-Llama-3.1-70B-Instruct-Turbo and Llama-3.3-70B-Instruct-Turbo with JSON mode

Product documentation 5

Pages from Together AI, used to check facts for every group.

  1. Third-party integrations

    Together's third-party integrations page lists the integrations that ship dedicated Together support, among them LiteLLM 1.100.0 and later and LangChain's langchain-together package.

    Checked Nov 1, 2026

  2. OpenAI compatibility

    Together's API is compatible with the OpenAI REST API and SDKs across chat, completions, vision, image generation, text-to-speech and embeddings.

    Checked Nov 1, 2026

  3. Privacy and security

    By default Together stores prompts and responses and may use them for product improvements. Organization admins can turn storage off to enable zero data retention, and data sharing for training other models is opt-in and not enabled by default.

    Checked Nov 1, 2026

  4. Serverless rate limits

    Together's serverless performance is best-effort. When demand is high, Together may limit requests, and you may receive 429 Too Many Requests or 503 Service Unavailable responses.

    Checked Nov 1, 2026

  5. Provisioned throughput

    Provisioned throughput reserves capacity for GLM-5.3, GLM-5.3 Flash, DeepSeek V4.1 Flash, GLM-5.2 and Kimi K3, at a flat US$0.05 per PTU per minute on a one-month minimum term.

    Checked Nov 1, 2026

Source index

Provenance at a glance

Every source GILD read, with the original address and the context used to count it. Open a finding to filter the full cards above. On smaller screens the index lists each source once by name, cohort and date; its full record above carries the address, context and findings.

Provenance for every analyzed Signals source
SourceOriginal URLAuthor and contextWhoPublishedReview dateAppliesFindings
Provider question (GLM 5.3 Flash)ID ta-28 | Developer Communitieswww.reddit.com/r/SillyTavernAI/comments/1xhutyv/provider_question_glm_53_flash/Opposite-Cup2850, Reddit (r/SillyTavernAI)self-described: Choosing a host for GLM-5.3-Flash in SillyTavernIndividual builderPublished Oct 28, 2026Assessment reviewed Nov 1, 2026Current
Same model, two services: gpt-oss-120b on Cerebras and Together (speed)ID ta-12 | Practitioner Blogs & Reviewsadvisee.substack.com/p/same-model-two-services-gpt-oss-120b#:~:text=A%20typical%20long%2Ddocument%20answer%20finishedSam Mirazi, data scientist and founder of BrAINself-described: His own test of gpt-oss-120b on two paid API accounts, 20 runs per service per testIndividual builderPublished Oct 25, 2026Assessment reviewed Nov 1, 2026Current
Same model, two services: gpt-oss-120b on Cerebras and Together (cost)ID ta-13 | Practitioner Blogs & Reviewsadvisee.substack.com/p/same-model-two-services-gpt-oss-120b#:~:text=A%20typical%20long%2Dprompt%20run%20costSam Mirazi, data scientist and founder of BrAINself-described: The same test, priced at each service's published rates on October 24, 2026Individual builderPublished Oct 25, 2026Assessment reviewed Nov 1, 2026Current
Hacker News comment recommending DeepSeek V4.1 Flash from together.aiID ta-02 | Developer Communitiesnews.ycombinator.com/item?id=50215603Josh Heitzman (joshheitzman), software engineer and creator of the FluxImp agent harnessself-described: Choosing a host for DeepSeek V4.1 Flash as a coding model, after open-sourcing their harnessIndividual builderPublished Oct 23, 2026Assessment reviewed Nov 1, 2026Current
G2 review of Together AI on AWS Marketplace by karan R.ID ta-14 | Practitioner Blogs & Reviewsaws.amazon.com/marketplace/reviews/reviews-list/prodview-3zxbbifggyplc#:~:text=The%20API%20limits%20requests%20per%20minutekaran R., G2 reviewerself-described: Builds voice agents for businesses on their own platformIndividual builderPublished Oct 21, 2026Assessment reviewed Nov 1, 2026Current
G2 review of Together AI on AWS Marketplace by Muhammad Basit J.ID ta-15 | Practitioner Blogs & Reviewsaws.amazon.com/marketplace/reviews/reviews-list/prodview-3zxbbifggyplc#:~:text=accounts%20are%20immediately%20placed%20into%20read%2Donly%20modeMuhammad Basit J., G2 reviewerself-described: A developer testing the platform's playground and APIIndividual builderPublished Oct 21, 2026Assessment reviewed Nov 1, 2026Current
Hacker News comment on GLM-5.3 on together.ai as a second reviewerID ta-06 | Developer Communitiesnews.ycombinator.com/item?id=49953903zzzeek, creator of SQLAlchemy, Alembic Migrations, dogpile.cache and Mako Templatesself-described: An open-source maintainer on a Claude Max subscription who uses open models when tokens matterIndividual builderPublished Oct 4, 2026Assessment reviewed Nov 1, 2026Current
Hacker News comment on running DeepSeek-V4-Flash-0731 through Kilo Code and his own harnessID ta-01 | Developer Communitiesnews.ycombinator.com/item?id=49735621Josh Heitzman (joshheitzman), software engineer and creator of the FluxImp agent harnessself-described: Benchmarking open-weight models across hosts with Kilo Code and an agent harness of their ownIndividual builderPublished Sep 17, 2026Assessment reviewed Nov 1, 2026Current
OpenRouter keeps routing calls to failing providerID ta-27 | Developer Communitieswww.reddit.com/r/openrouter/comments/1wf2v9b/openrouter_keeps_routing_calls_to_failing_provider/GT95, Reddit (r/openrouter)self-described: A system administration task in the Hermes agent, routed by OpenRouterIndividual builderPublished Sep 13, 2026Assessment reviewed Nov 1, 2026Current
Hacker News comment on noisy hosted results in gpt-oss red-teamingID ta-05 | Developer Communitiesnews.ycombinator.com/item?id=49670526Nils Durner (ndr_), technologist in generative AI, security and privacy, author of arXiv:2510.01259self-described: Red-teaming research for OpenAI's gpt-oss competition, published as arXiv:2510.01259Individual builderPublished Sep 12, 2026Assessment reviewed Nov 1, 2026Current
So you want to use OpenRouter? (hollow completions)ID ta-40 | Practitioner Blogs & Reviewsmmoustafa.com/blog/so-you-want-to-use-openrouter/Mo Moustafa, AI Product Engineer for Startups, runs Ollyself-described: Olly, an iMessage assistant on open models through OpenRouterIndividual builderPublished Sep 7, 2026Assessment reviewed Nov 1, 2026Current
So you want to use OpenRouter? (image input by host)ID ta-41 | Practitioner Blogs & Reviewsmmoustafa.com/blog/so-you-want-to-use-openrouter/#:~:text=Venice%20and%20Together%20didnMo Moustafa, AI Product Engineer for Startups, runs Ollyself-described: Olly, an iMessage assistant on open models through OpenRouter, testing image input per hostIndividual builderPublished Sep 7, 2026Assessment reviewed Nov 1, 2026Current
Hacker News comment on GLM-5.3-Flash via together.ai against DeepSeek V4 FlashID ta-03 | Developer Communitiesnews.ycombinator.com/item?id=49480864Peter Sugihara (rgbrgb), co-founder of Open Listingsself-described: A personal ad-detection task over written transcripts, ten tasks per runIndividual builderPublished Aug 28, 2026Assessment reviewed Nov 1, 2026CurrentListed, no finding position
Hacker News comment on a mixture of open-weight models through Together.ai and Fireworks.aiID ta-22 | Developer Communitiesnews.ycombinator.com/item?id=49417855dkersten, Hacker Newsself-described: Their own coding work, after leaving a closed-model service they call unreliableIndividual builderPublished Aug 24, 2026Assessment reviewed Nov 1, 2026Current
Hacker News comment on running new Chinese models on US providersID ta-24 | Developer Communitiesnews.ycombinator.com/item?id=48981940joecot, Hacker Newsself-described: Choosing where to run newly released open-weight modelsIndividual builderPublished Jul 20, 2026Assessment reviewed Nov 1, 2026Current
Reply on OpenRouter billing compared with together.ai refundsID ta-26 | Developer Communitieswww.reddit.com/r/openrouter/comments/1v0c1ay/please_your_experience_with_openrouter_why_are/oyeje0w/Evening-Guarantee-84, Reddit (r/openrouter)self-described: Prepaid credit left unused on TogetherIndividual builderPublished Jul 19, 2026Assessment reviewed Nov 1, 2026Current
Mark 6 removed Together.ai serverless models as deprecatedID ta-20 | Developer Communitiesgithub.com/anomalyco/models.dev/issues/3324Max Collier (mcwalrus), software engineer, entain-group on his GitHub profileself-described: Checking the models.dev catalog against Together's serverless endpointIndividual builderPublished Jul 18, 2026Assessment reviewed Nov 1, 2026Current
Together.ai models to be deprecated July 10ID ta-19 | Developer Communitiesgithub.com/earendil-works/pi/issues/6132Max Collier (mcwalrus), software engineer, entain-group on his GitHub profileself-described: Keeping the pi coding agent's Together model list currentIndividual builderPublished Jun 28, 2026Assessment reviewed Nov 1, 2026Current
Together.ai MiniMaxAI/MiniMax-M2.5 model doesn't work with serverless inferenceID ta-30 | Developer Communitiesgithub.com/earendil-works/pi/issues/5506Eric Henry (awakenalive), TrueVektor Developmentself-described: Selecting a Together model in the pi coding agent on pay-per-token serverlessIndividual builderPublished Jun 8, 2026Assessment reviewed Nov 1, 2026Current
bug: max_output_tokens setting doesn't work with Together.aiID ta-17 | Developer Communitiesgithub.com/janhq/jan/issues/8267Branko Radovanović (brankoradovanovic-mcom), Multicom d.o.o.self-described: The Jan desktop client with Together.ai as its remote providerIndividual builderPublished Jun 3, 2026Assessment reviewed Nov 1, 2026Current
Hacker News comment on together.ai outages and latencyID ta-04 | Developer Communitiesnews.ycombinator.com/item?id=48200664HDBaseT, Hacker Newsself-described: An aside in a thread about open-model hostsIndividual builderPublished May 19, 2026Assessment reviewed Nov 1, 2026Current
Hacker News comment on Together.ai's price against DeepSeek's own APIID ta-25 | Developer Communitiesnews.ycombinator.com/item?id=48090537pants2, Hacker Newsself-described: Weighing US hosts against DeepSeek's first-party pricingIndividual builderPublished May 11, 2026Assessment reviewed Nov 1, 2026Current
Release a langchain-together 1.0 without dependency conflictsID ta-39 | Developer Communitiesgithub.com/langchain-ai/langchain-together/issues/31Santiago Martinez Bragado (smartinezbragado), Trazaself-described: Traza's workspace on LangChain 1.xIndividual builderPublished Mar 24, 2026Assessment reviewed Nov 1, 2026Current
Ephemeral chat. Private, secure, chat with together.ai open source models.ID ta-11 | Developer Communitieswww.reddit.com/r/LocalLLaMA/comments/1qyp9wb/ephemeral_chat_private_secure_chat_with/slippery, builder of Ephemeral, an open-source chat app built on Togetherself-described: Ephemeral, their open-source web chat app on Together's Kimi-K2.5Individual builderPublished Feb 7, 2026Assessment reviewed Nov 1, 2026Current
Change model qwen/qwen3-coder-next from together.ai to openrouterID ta-29 | Developer Communitiesgithub.com/OpenHands/software-agent-sdk/issues/1899Juan Pedro Michelini Jorge (juanmichelini), MTS @ Openhands: Evals, benchmarks, leaderboards, harnessself-described: The OpenHands agent SDK's evaluation runs, calling models through LiteLLMProduct or platform teamPublished Feb 4, 2026Assessment reviewed Nov 1, 2026Current
seed must not be set when best_of is greater than 1ID ta-38 | Developer Communitiesgithub.com/togethercomputer/together-python/issues/418Roman Vashurin (rvashurin), research engineer at MBZUAIself-described: Uncertainty-quantification research that needs several seeded completions per promptIndividual builderPublished Jan 16, 2026Assessment reviewed Nov 1, 2026Current
Having a problem with the together.ai apiID ta-09 | Developer Communitieswww.reddit.com/r/LocalLLaMA/comments/1oamwjp/having_a_problem_with_the_togetherai_api/Infamous_Sector_6411, Reddit (r/LocalLLaMA)self-described: Personal projects on AnythingLLM, with €15 of Together creditsIndividual builderPublished Oct 19, 2025Assessment reviewed Nov 1, 2026Still applicable
Reply on truncated answers from the together.ai apiID ta-10 | Developer Communitieswww.reddit.com/r/LocalLLaMA/comments/1oamwjp/having_a_problem_with_the_togetherai_api/nkdl60l/abnormal_human, Reddit (r/LocalLLaMA)self-described: Replying in the same thread from their own usage across many use casesIndividual builderPublished Oct 19, 2025Assessment reviewed Nov 1, 2026Still applicable
Fix access to Llama-3.3-70B-Instruct modelID ta-16 | Developer Communitiesgithub.com/debatelab/evidence-seeker/issues/6wleonie, collaborator on debatelab/evidence-seekerself-described: A multi-step evidence-checking pipeline that uses grammar-constrained outputIndividual builderPublished Sep 18, 2025Assessment reviewed Nov 1, 2026Still applicable
Agent seems unable to do anything using together.aiID ta-31 | Developer Communitiesgithub.com/anomalyco/opencode/issues/2169#issuecomment-3215577545David Else (David-Else), software developer, Else Web Developmentself-described: The opencode coding agent on Together-hosted open models, with no proxyIndividual builderPublished Aug 22, 2025Assessment reviewed Nov 1, 2026Still applicable
Cannot use GPT-OSS-120b with ChatTogether and tools for create_react_agentID ta-18 | Developer Communitiesgithub.com/langchain-ai/langchain-together/issues/19Sagar (sagar-catomz), GitHubself-described: A LangGraph ReAct agent on ChatTogetherIndividual builderPublished Aug 20, 2025Assessment reviewed Nov 1, 2026Still applicable
Hacker News comment recommending together.ai for usage-based billingID ta-23 | Developer Communitiesnews.ycombinator.com/item?id=44804100joecot, Hacker Newsself-described: Occasional use of open-source modelsIndividual builderPublished Aug 5, 2025Assessment reviewed Nov 1, 2026Current
Use alternative of TogetherAIID ta-21 | Developer Communitiesgithub.com/ABarpanda/Animegen/issues/9Amritanshu Barpanda (ABarpanda), aspiring AI engineer, Advanced Engineering Hire intern at Accenture Pune from May to July 2026self-described: Animegen, his image-generation project, on Together's free FLUX modelIndividual builderPublished Jul 19, 2025Assessment reviewed Nov 1, 2026Still applicable
Got Out of Credits Email from Together AI While Only Using Free Model and Still Have $1 in BalanceID ta-08 | Developer Communitieswww.reddit.com/r/LocalLLaMA/comments/1m1opwv/got_out_of_credits_email_from_together_ai_while/Wild_King_1035, Reddit (r/LocalLLaMA)self-described: An app calling the free llama-3-70b-instruct-turbo-free model through the Together API for about a monthIndividual builderPublished Jul 16, 2025Assessment reviewed Nov 1, 2026Still applicable
Hacker News comment on Gemma E4B on together.aiID ta-07 | Developer Communitiesnews.ycombinator.com/item?id=44459677impure, Hacker Newsself-described: Trying a small open model on together.ai against Gemini 2.5 Flash LiteIndividual builderPublished Jul 3, 2025Assessment reviewed Nov 1, 2026Still applicable
Llama 4 Scout on together_ai returns tool calls in the message textID ta-37 | Developer Communitiesgithub.com/BerriAI/litellm/issues/11453Jarett (JarettForzano), Vals AIself-described: A tool-using agent calling Together through LiteLLMIndividual builderPublished Jun 5, 2025Assessment reviewed Nov 1, 2026Still applicable
The together library adds over 100MB of dependenciesID ta-36 | Developer Communitiesgithub.com/togethercomputer/together-python/issues/320Matthias Geihs (matthiasgeihs), cryptography engineer and systems architect at Consensysself-described: Calling Together from small shared test VMsIndividual builderPublished Jun 3, 2025Assessment reviewed Nov 1, 2026Still applicable
Unclosed client session errors from the async client after a few batch callsID ta-35 | Developer Communitiesgithub.com/togethercomputer/together-python/issues/296Venkat (venkatasg), assistant professor of computer science at Ithaca Collegeself-described: Research batches of DeepSeek-V3 calls on Build tier 3Individual builderPublished Apr 17, 2025Assessment reviewed Nov 1, 2026Still applicable
Remove the pyarrow dependency from the together Python SDKID ta-34 | Developer Communitiesgithub.com/togethercomputer/together-python/issues/274Steve Cosman (scosman), building Kiln (kiln.tech), formerly Apple Photos AIself-described: Shipping Kiln, an app that bundles model-provider SDKsIndividual builderPublished Mar 19, 2025Assessment reviewed Nov 1, 2026Still applicable
together fine-tuning list crashes with a validation errorID ta-33 | Developer Communitiesgithub.com/togethercomputer/together-python/issues/246Carl Silva (silvacarl2), Sphinx Medical Technologiesself-described: Managing fine-tuning jobs from Together's command-line clientIndividual builderPublished Feb 2, 2025Assessment reviewed Nov 1, 2026Still applicable
JSON mode on Llama 3.1 and 3.3 70B Turbo returns invalid JSONID ta-32 | Developer Communitiesgithub.com/togethercomputer/together-python/issues/232Shivanshu Gupta (Shivanshu-Gupta), NLP and AI researcher, Adobe on his GitHub profileself-described: Generating structured agent traces on Together's serverless Llama 70B Turbo modelsIndividual builderPublished Jan 8, 2025Assessment reviewed Nov 1, 2026Still applicable
Third-party integrationsID td-01 | Product Documentationdocs.together.ai/docs/inference/sdk-integrations.mdTogether AIOfficialNot counted (documentation)No date statedDocumentation checked Nov 1, 2026CurrentVerification only
OpenAI compatibilityID td-02 | Product Documentationdocs.together.ai/docs/inference/openai-compatibility.mdTogether AIOfficialNot counted (documentation)No date statedDocumentation checked Nov 1, 2026CurrentVerification only
Privacy and securityID td-03 | Product Documentationdocs.together.ai/docs/privacy-and-security.mdTogether AIOfficialNot counted (documentation)No date statedDocumentation checked Nov 1, 2026CurrentVerification only
Serverless rate limitsID td-04 | Product Documentationdocs.together.ai/docs/serverless/rate-limits.mdTogether AIOfficialNot counted (documentation)No date statedDocumentation checked Nov 1, 2026CurrentVerification only
Provisioned throughputID td-05 | Product Documentationdocs.together.ai/docs/inference/provisioned-throughput.mdTogether AIOfficialNot counted (documentation)No date statedDocumentation checked Nov 1, 2026CurrentVerification only