Sonnet/Claude Code may technically be "smarter", but Qwen3-Coder on Cerebras is often more productive for me because it's just so incredibly fast. Even if it takes more LLM calls to complete a task, those calls are all happening in a fraction of the time.
We must have very different workflows, I am curious about yours. What tools are you using and how are you guiding Qwen3-Coder? When I am using Claude Code, it often works for 10+ minutes at a time, so I am not aware of inference speed.
You must write very elaborate prompts for 10 minutes to be worth the wait. What permissions are you giving it and how much do you care about the generated code? How much time did you spend on initial setup?
I‘ve found that the best way for myself to do LLM assisted coding at this point in time is in a somewhat tight feedback loop. I find myself wanting to refine the code and architectural approaches a fair amount as I see them coming in and latency matters a lot to me here.
2 minutes is the worst delay. With 10 minutes, I can and do context switch to something else and use the time productively. With 2 min, I wait and get frustrated and bored.
Context switching makes you less productive compared to if you could completely finish one task before moving to the other though. in the limit an LLM that responds instantly is still better.
> Sonnet/Claude Code may technically be "smarter", but Qwen3-Coder on Cerebras is often more productive for me because it's just so incredibly fast.
Saying "technically" is really underselling the difference in intelligence in my opinion. Claude and Gemini are much, much smarter and I trust them to produce better code, but you honestly can't deny the excellent value that Qwen-3, the inference speed and $50/month for 25M tokens/per day brings to the table.
Since I paid for the Cerebras pro plan, I've decided to force myself to use it as much as possible for the duration of the month for developing my chat app (https://github.com/gitsense/chat) and here so some of my thoughts so far:
- Qwen3 Coder is a lot dumber when it comes to prompting as Gemini and Claude are much better at reading between the lines. However since the speed is so good, I often don't care as I can go back to the message and make some simple clarifications and try again.
- The max context window size of 128k for Qwen 3 Coder 480B on their platform can be a serious issue if you need a lot of documentation or code in context.
- I've never come close to the 25M tokens per day limit for their Pro Plan. The max I am using is 5M/day.
- The inference speed + a capable model like Qwen 3 will open up use cases most people might not have thought of before.
I will probably continue to pay for the $50 dollar plan for these use cases.
1. Applying LLM generated patches
Qwen 3 coder is very much capable of applying patches generated by Sonnet and Gemini. It is slower than what https://www.morphllm.com/ provides but it is definitely fast enough for most people to not care. The cost savings can be quite significant depending on the work.
2. Building context
Since it is so fast and because the 25M token limit per day is such a high limit for me, I am finding myself loading more files into context and just asking Qwen to identify files that I will need and/or summarize things so I can feed it into Sonnet or Gemini to save me significant money.
3. AI Assistant
Due to it's blazing speed, you can analyze a lot data fast for deterministic searches and because it can review results at such a great speed, you can do multiple search and review loops without feeling like you are waiting forever.
Given what I've experienced so far, I don't think Cerebras can be a serious platform for coding if Qwen 3 Coder is the only available model. Having said that, given the inference speed and Qwen being more than capable, I can see Cerebras becoming a massive cost savings option for many companies and developers, which is where I think they might win a lot of enterprise contracts.
SlateDB offers different durability levels for writes. By default writes are buffered locally and flushed to S3 when the buffer is full or the client invokes flush().
While your technical analysis is excellent, making judgements about workload suitability based on a Preview release is premature. Preview services have historically had significantly lower performance quotas than GA releases. Lambda for example was limited to 50 concurrent executions during Preview, raised to 100 at GA, and now the default limit is 1,000.
Grok are the first models I am boycotting on purely environmental grounds. They built their datacenter without sufficient local power supply and have been illegally powering it with unpermitted gas turbine generators until that capacity gets built, to the significant detriment of the local population.
Imagine needing electricity and government contracts so much that you spend $250M to get somebody elected president, and the second thing your guy does in office is cancel all of the projects that could provide you with more electricity.
And then he posts about it literally every day moaning about the lack of power, lack of solar, etc. All the things he bitches and moans about are things he caused by helping elect the orange fella.
By his own words, Elon is not an environmentalist and doesn’t seem to believe much in humanity’s impact on the climate. His concern is with the futility of relying on a non-renewable resource. He believes there is significantly more lithium than there is oil, I guess.
In the end, incentives are all that matter. Do hotels care deeply about the environment, or are they interested in saving in energy and labor costs as your towel is cleaned? Does it matter? Does moralizing really get us anywhere if our ends are the same?
I know it’s in vogue to dump on Elon these days, and with good reason, but do I not recall him on a number of occasions quite emotionally describing our continued CO2 emissions as the dumbest experiment in human history?
Yeah, but he flip-flops on the daily. He used to post about how LGBT positive Tesla was and post pride flags on his feed and now he's trying to burn the planet to the ground every time he hears about anyone that isn't a straight white man.
You do, and then at some point, likely during a late night ketamine binge, he went full redpill on twitter and decided the only thing that matters is “owning the libs”.
If that means embracing fossil fuels, so be it. Destroy the “woke mind virus at any cost”. That being said, I think he is delusional enough that he thought allowing nazi propaganda on twitter would convince conservatives to start buying teslas and is completely lost at this point.
That's just one facet of EVs that is severely overplayed in my book. They have plenty of other benefits, but for some of us the environmental aspect is a "nice-to-have".
I'm inclined to say the exact opposite about EVs. They take up as much space as internal combustion engine vehicles (in terms of streets, highways and parking lots), are just as fatal to pedestrians, make cities and neighborhoods less livable, cost in the tens of thousands of dollars, create traffic jams... the primary benefit is reducing our dependence on fossil fuels and generating less CO2. That's the number one differentiator. Faster acceleration, etc. is a nice-to-have.
> the primary benefit is reducing our dependence on fossil fuels and generating less CO2
for many, it's not even that. I like EVs primarily because I'm a tech-savvy person and like computers on wheels. but I'm also aware of their numerous downsides.
I care enormously about protecting the environment and stopping climate change, but I'm not an environmentalist.
Environmentalists usually care about the environment for its own sake, but my concern is our own survival. Similarly, I don't intrinsically care about plastic in the ocean, but our history of harming ourselves with waste we think is harmless would justify applying the precautionary principle there too.
As far as Musk goes, it's hard to track what he actually believes versus what he has said to troll, kowtow to Trump or "own the libs", but he definitely believes in anthropogenic climate change and he has been consistent on that. He seems to sometimes doubt the predictions of how quick it will occur and, most of all, how quickly it will impact us.
I think there probably is a popular tendency to overstate the predictive value of certain forecasts by simply grouping all climate science together. In reality, the forecasts have tended to be extremely accurate for the first order high level effects (i.e. X added carbon leads to Y temperature increase), but downstream of that the picture becomes more mixed. Particularly poor have been predictions of tipping points, or anything that depends on how humans will be affected by, or react to, changes in the environment.
Yes, Elon is probably playing fast and loose with the rules, but his 150MW of turbines are right next to the TVA's 1100MW of turbines and a steel mill. Not surprising given that it's a heavy industrial area, it's about 4 miles from any significant number of houses. There are plenty of good reasons to hate on Elon, but IMO this ain't it.
If thats the yard stick you should boycott everything coming out of china, which is pretty much everything, since they are one of the largest polluters globally.
Wouldn't you expect the country with the most manufacturing and one of the biggest population to also have the biggest pollution?
I feel you'd need to adjust the sum total by something, capita, or square footage or be more specific like does a manufacturing X in China pollute more than an equivalent one in the US, etc.
Not all goods and services involve the same process, some come with more pollution.
For example, Nvidia will contribute to a big chunk of US GDP, but it only designs the chips, which won't have the same pollution impact as the country in which they'll have it manufactured.
Doesn't really make sense in my opinion. Why boycott a specific group of people for their collective emissions when their individual emissions are lower than many others? The latter is the important metric, else you're simply punishing them for having a large population.
Well Elon really worked hard to get that done. Campaigning for the guy who is cancelling in-progress solar and wind projects and claiming the feds will never approve another green energy plant.
Most people aren't programming or operating heavy machinery at 4AM, either. Most power is consumed in the day, and most AI will be leveraged in the day.
(1) the utilization factor over the obsolescence-limited "useful" life of the hardware;
(2) the short-term (sub-month) training job scheduling onto a physical cluster.
For (1) it's acceptable to, on average, not operate one month per year as long as that makes the electricity opex low enough.
For (2) yeah, large-scale pre-training jobs that spend millions of compute on what's overall "one single" job, those are often ok to wait a few days to a very few weeks as would be from just dropping HPC cluster system operation to standby power/deep sleep on the p10 worst days each year as far as renewable yield in the grid-capacity-limited surroundings of the datacenter goes.
And if you can further run systems a little power-tuned rather than performance-tuned when power is less plentiful, to where you may average only 90% theoretical compute throughput during cluster operating hours (this is in addition to turning it off for about a month worth of time), you could reduce power production and storage capacity a good chunk further.
China controls 80% of the supply chain for solar and has most of the rare earth magnets needed for wind. Since China is America’s bugbear and containing China’s influence is a bipartisan issue, this was a likely outcome whoever is in office
We don't have to guess what the most likely outcome might have been, someone else was in office 7 months ago so we can just look at what they were doing.
Were they "cancelling in-progress solar and wind projects and claiming the feds will never approve another green energy plant"? That's the "likely outcome" we're discussing.
Yes, the US has been scaling back on China-sourced renewable energy supply chains since 2023 at least, with tariffs and by removing incentives
Not exactly your wording at that time, but my point still stands that the outcome was going to be the same because the imports were heavily skewed towards China. This has all been in motion before this current admin
Technology does not exist separately from society and culture, and in the last few decades has arguably made a lot of the world and society worse. I’m all for using the biggest lever I have to address harmful behaviors from corporations. Withhold your wallet, stay off their platforms and make your reasons known.
I mean… this is part of GPs point. Here we are, playing on the lawn of private equitists, probably directly or indirectly working for the people that GGP was railing against.
Reading about mainframes feels very much like reading science fiction. Truly awesome technology that exists on a completely different plane of computing than anything else.
This thinly veiled advertisement claims it's a waste of time to understand the tradeoffs in the models you're using, and you should instead pay them to make those decisions for you. No thank you.
Per the ongoing Freedesktop discussion, AWS offered to host but Freedesktop is leaning towards self-hosting on Hetzner so they can control their own destiny and sponsors can contribute cash towards the bill instead of donating hardware.
I saw their original announcement and they said that their infra (3 AMD EPYC from generations ago, 3 Intel servers from 2 generations ago, 2 80-core ARM servers) would cost $24k/month at Equinix prices. I checked Hetzner's equivalent offerings, it would be ~$1.5k/month for newer AMD servers. It would probably be even less if they went with older servers listed at their auction. And it probably would be even less if they just moved their CI runners to virtual servers on Hetzner's cloud.
Seriously, Hetzner provides so much move value per dollar, sometimes I fear that one day they will find out and just jack up the prices to match the rest.
VPS business is very different than the "cloud" space.
Yes yes there are cloud features now offered by VPS providers, but they are add ons to chase demand, they aren't positioning their offering to appeal to users wanting a comprehensive suite of services on the platform. Managed databases, SMTP as a service, deployment as a service etc etc etc. For that reasons market rates are different.
For Hetzner to bump their prices significantly they would need to build a cloud platform a la AWS/GCP/Azure. Won't happen by Xmas even if went all in. They are good at what they do and make money so they stick to that.
Of course they are not in the hyperscaler space, but they are far from being "just" a VPS provider.
Their cloud always had on-demand, per-hour billing of servers and block storage volumes, all very easy to manage and provision via their API. Recently they got into object storage space. They even provide a switch to connect their cloud servers with a dedicated one, so you can have, e.g, a beefy GPU server running a LLM model and your web service auto running on the cheap.
I believe that the only thing that really holds Hetzner at their price levels is that the price-sensitive people can always threaten to move to OVH.
OVH or to hundreds of other less known infra providers.
The barrier to entry for these providers is simply, "low". So margins got to be low.
The thing that holds Hetzner and the likes is you can't purchase a package, follow the setup instructions to make cross disciplines engineering departments. It is no wonder Amazon, Google and Microsoft built a comprehensive cloud. They were in the engineering business.
It doesn't imply Hetzner aren't doing a stunning job at what they do or that running an infrastructure farm is a walk in the park.
Hetzner also has the interesting choice of consumer-grade machines which probably work fine in cases where you are constrained by CPU power rather than memory capacity/bandwidth. You'll also lose a bit of redundancy and reliability but that might not be as big of a deal since the machines are managed by them and you can probably get things replaced quickly. For example depending on the workload the CCX43s might be replaceable by the AX52.
Meanwhile for CI runners you probably could split the big bare metal servers down into smaller individual machines and run less jobs of them. Depending on the CI load profile it might also make even more sense to scale out to the cloud on high demand as opposed to having a bunch of mostly idle machines.
Hetzner has a great price but it plays not in the same league as AWS. It's cheap and good enough for some applications but I wouldn't call Hetzner a professional service.
The USA being "Free" has mostly been a myth. It's "Free" if you're a member of the owner class, else you're freedom is subject to the whims of politicians and the wealthy. Aristocracy, really.
Yes agreed, although I think it's worth pointing out that the same is true of virtually every other country as well. Historically at least the US (generally speaking, plenty of people are exceptions throughout the entire history) aspired to freedom and equality, despite falling short.
True, but the spirit of the law died a long time ago, and the vision originally created by the founders has been distorted and "mythified" in favor of the desires and vices of monied interests.
Everybody I know is happy with what Hetzner provides, even at production level. OTOH, "arguably better" DigitalOcean sent me a "Your physical host died, so we restarted it. If it persists, we'll migrate" e-mail, which just shows the reality of the hardware.
On your question, while I do not have services on Hetzner yet, I manage a lot of servers, so I know dynamics of a datacenter and what it entails to keep one up.
You're linking this everywhere, but it has absolutely zero relevance.
Your beef is not with Hetzner, but whoever decided to run the service. Unless the customer violates local legislation or the hosting providers ToS, the appropriate action is to leave the service running, be it AWS, GCP or Hetzner.
I would quite frankly have been very disappointed with them if they had done anything in response to you request.
There is no beef, just evidence that they do to run their service as professionally as other more established providers, which was the original argument and premise of the discussion.
Hetzner is German company and subject to German law. The website they were hosting did not have the (in Germany) mandatory legal notice (Impressum) or any contact details. This shifts the responsibility to the provider (Providerhaftung). Ignoring legal requirements is hardly professional.
Also I would like to note that I did neither request them to give me their customer's details nor to shut down the site. All I wanted was them to work with their customer to have the offending image removed.
Also I am convinced the porn image was not malice but an accident. The scraper replaced all profile images with ones they probably scraped from a forum. I was just unlucky to get a very indecent one.
Had Hetzner collaborated I'm pretty sure this could have been resolved in no time.
Your expectations of what you wanted from Hetzner has nothing to do with their professionalism. They most certainly acted with outmost professionalism given the situation you describe, and the behavior to be expected from any hosting provider.
I get your frustration in the situation, but even if it would have been helpful to you, it
would be extremely unprofessional for a hosting provider to invervene in the operations of its customers unless the customer violates the Terms of Service (an agreement you have no part in), a court order is made, or law enforcement makes a legally supported demand. Random legal notices sent by mail from strangers are not on this list, but could lead to Hetzner evaluating if a ToS violation is in effect that must be resolved.
If the customer is a business, it could be that they have breached the Impressum laws. It would have helped you if they had the impressum, but until legal action is taken it remains undecided if there is a violation, and if there was the consequence would be that the customer is liable for a written warning and in some cases a fine, as decided by the relevant authorities or a court of law.
I disagree. For one thing I think you misinterpret the legal situation. This is Germany, the provider is on the hook. Secondly, you do not have insight into the communication and I won't share it but I assure you their conduct was unprofessional.
Single machines die (and can't be started again for a few minutes to hours) every few months, but that's acceptable for me, and we also similar things happen at AWS.
I do. I just rent 2 computers from Hetzner. One is main another is failover. If main dies failover kicks in while main is restored on another computer. Still way way cheaper than AWS which I would not touch with wooden pole unless required by client.
They were hosting a StackOverflow copy, which is OK because of Creative Commons. All my answers were still under my name as it should be.
The only difference to the original was my profile picture, which was an explicit porn image.
For several weeks everyone searching for my name or my StackOverflow answers saw that. I'm glad that I was not looking for a job at the time.
I exhausted all possibilities on all channels to rectify this situation short of using a lawyer.
I put a lot of effort into getting things in order and seriously considered going the legal route but ultimately decided against it mainly because courts are hit and miss here when it comes to reputation damage of regular individuals as opposed to companies or celebrities.
EDIT: I should have answered your question how this is Hetzner's fault more directly. The website they were hosting did not have the (in Germany) mandatory legal notice (Impressum) or any contact details. This shifts the responsibility to the provider (Providerhaftung). Also I would like to note that I did neither request them to give me their customer's details nor to shut down the site. All I wanted was them to work with their customer to have the offending image removed.
Also I am convinced the porn image was not malice but an accident. The scraper replaced all profile images with ones they probably scraped from a forum. I was just unlucky to get a very indecent one. Had Hetzner collaborated I'm pretty sure this could have been resolved in no time.
Hi there, would you mind giving me the abuse ID for this case. (When someone creates an abuse report with us, our confirmation email includes an abuse ID in the subject line.) If you still have that, and you would like me to ask a colleague about this case, please let me know.
--Katie, Hetzner Online
To the best of my recollection I was never assigned or at least told one. I was not a customer so when my contact attempts were not ignored or answered with boilerplate, I was asked for my customer details, which I could not provide. No customer details, no support.
The channels to reach you were pretty limited and hard to find when I tried. I assure you, I tried everything short of getting a lawyer to send you paper mail.
I still have the communication history in my archives, but it would be a little effort to dig it out.
EDIT:
Found the documentation. My first complaints were in March 2011. At some point I got assigned an abuse ID MU-000B0F55-1:18. In May the issue was still unresolved.
Hi again, Looking on the date for that, we don't have data about that case simply because of data protection laws that require us to delete data after a certain time. Does the abuse still exist? If so, perhaps you can create a new ticket (and include the old abuse ID from 2011 so that they understand you tried to report this in the past. You can also include a link to this thread in hackernews and mention my name.) When you submit your abuse report, you will receive an automated response with a new abuse ID. You do not need to be a customer to submit an abuse report with us. https://abuse.hetzner.com/en?lang=en Unfortunately, I cannot submit an abuse report on your behalf. --Katie
Because they own the CDN and most of the bandwidth is from peering, so it essentially costs them nothing.
Netlify on the other hand has to pay per GB to AWS.
Netlify manages to be wildly overpriced even by AWS standards, CloudFront starts at about $85/TB, which isn't cheap by any means, but that turns into $550/TB(!!) if you go through Netlify. They have some of the most obscene bandwidth pricing in the industry by a huge margin, and to add insult to injury they don't allow you to set a spending limit either.
