Latest Hosting News on Reddit

I’m building a startup and part of it requires me to run untrusted user code (gvisor). I’m currently using digitalocean for running and building docker images but it’s pretty expensive (luckily I have credits). I don’t use any of digitaloceans native features. Anyone have any good suggestions? I don’t need latency to be that low (max 400-500ms) so even if locations provided aren’t as many as DO it’s alright. submitted by /u/Routine_Revenue7470 [link] [comments]

I’m developing Reame to explore a specific question: can inexpensive CPU hardware run genuinely useful LLM workloads without a GPU? The answer seems to depend more on the workload than on raw generation speed. Extraction, classification and batch jobs often reuse the same context and do not always need a large general-purpose model. On a free 2-core ARM machine, OLMoE 7B-A1B reached 26.7 tokens/s and completed our extraction test with 8/8 correct answers. A dense 7B reached 3.3 tokens/s on the same machine. Reame adds persistent prefix caching, adaptive speculative decoding and an OpenAI-compatible API around llama.cpp. you can find the project on github with user swellweb. submitted by /u/Annual_Manner_5901 [link] [comments]

Here’s a short story of my last 10 years in a startup that we built from the ground up on bare metal. tl;dr: Hetzner is good, amazing value. Online,net is a mixed bag and their network is quite unreliable. Nuanced explanation further down. Some background: We were one of the first companies ever to run Kubernetes in production, and our architecture was built around microservices from day 1. I won’t name the company, but it got acquired twice, now being owned by a company with hundreds of billions in revenue. We were EBITDA-profitable after about 2-3 years since launching in production. My role: a little bit of everything guy, developer, architect, DBA, SRE, devops, security engineer, CI/CD etc. I was responsible for a lot of monitoring and incident response and post-mortem. Most of our production hardware was running on Online,net which is now fully rebranded as Scaleway, but I’ll keep referring to them as Online. (Back then, “Scaleway” was just their sub-brand for small cheap VMs.) The smallest machines we were renting were something like Xeon E3 1230 with 64+GB RAM and some SSDs/NVMes when that became a thing (Believe it or not, M.2 port didn’t always exist.) In total, we had several dozen servers rented over the years. Forgot exactly, but over 60. I don’t want to trivialize the whole 10 years and make it sound like Online gave us constant nightmares, but I can’t pretend they really cared either. Occasional hardware faults were treated with “looks good to me” and you had to actually teach them how to test the faulty disk or w/e. But those were rare. The most common problem was with their network. Our ops staff chose Online because they had generally good reputation, provided “Real Private Network” and were slightly cheaper than OVH (and didn’t know about Hetzner back then, or it didn’t exist). However, the more servers we rented, the more it was clear that the network hardware was saturated. The folk story explanation was “kids rent Online hardware to download torrents” and the network quality generally reflects that. At some point I wrote a custom utility that tried to connect each node to each node, simple HTTP requests, large packet HTTP requests, and long-lived connections. First thing was very obvious how the lowest latencies were between machines on the same rack – not surprising, of course – but because sometimes we had two machines that couldn’t see each other on the network, but other machines could access both of them – we quickly realized we have to reverse engineer their IP addresses to allocate servers that needed quorum (Kafka, etcd) on the same rack. Especially Kafka with HDDs (back when it still used ZooKeeper) was extremely sensitive to higher latencies. There were regular packet loss + latency spikes. We could clearly see it from Grafana, both results from my custom tool and from a simpler ping everything-to-everything monitoring, just 2-5 minutes of 70% packet loss sometimes, sometimes just latency went up from ~10ms to like 800ms for a few minutes. We gave up on reporting those because the support just gave us “idk seems fine to me now”. The only time when we had several hours of downtime for a few servers they, after many emails, apologized and said that we’re eligible for a partial refund and gave us literally 20 euro because we had 20 hours of downtime. Amazing. Yolo swag we can buy our Ferrari now. Eventually we rented OVH for some off-site backups, but only a few machines and they were low-use so we didn’t have any issues with them IIRC. One nice thing about Online was their cold storage – literally cold, IIRC they were hosting servers in literal crypts or nuclear bunkers or something bonkers like that. Data on those wasn’t online, and took a day to restore, but it was good for storing older elasticsearch logs. Back then Backblaze B2 didn’t exist, so it was the cheapest option, something like 10-20x cheaper than average big tech cloud storage. — We introduced Hetzner only around 2021 and only for dev environment – i.e. we never ran production on it, and didn’t have a private network, although it would be doable with wireshark, Online had the hypothetical benefit of their supposed Real Private Network. (Side note: quickly we ran into issues with Online when we needed to download something to Hetzner machines from Online machines, which ran at like 100kB/s, but when we downloaded it from OVH or from 3rd party american servers, it downloaded at 2-20MB/s so clearly Hetzner wasn’t the problem. And no, we didn’t have any throttling set up on our side, nor had any bandwidth limits set up or imposed on us by Online or CDN). Overall my experience with Hetzner was positive, and they gave us volume discounts after we got like 30+ machines (total was 60+), but again, none of those had 24/7 monitoring on them. We rented exclusively the cheapest AMD machines with 64GB RAM and 2x500GB SSDs. We had a few hardware problems, once I think the hard drives or RAM were faulty, which they replaced without much hassle, several times (more than 10) some machines were frozen during reboot and sometimes you had to hard-reboot them via the admin interface, but often it didn’t work and we needed to contact the support to physically cold-reboot them. Sometimes they responded in minutes, sometimes in a few hours, but it was always straightforward, just one sentence email from us and then “done” email from them. — As a bonus story, we used a CDN called Incapsula, which they mysteriously renamed to Imperva after they suffered a hack which leaked all of business customer data. Oops! Honestly they left a bittersweet taste, some features worked very nicely (WAF was functional and caught all traditional SQL injects, not that we ever had those exposed ha ha awkward smile) but they also injected a mysterious javascript into our index.html and it worked quite poorly with, you know, super modern web 2.0 websites that use this cool technology called “AJAX”. If you’re not a web developer, I’m being sarcastic, literally 99.9% of websites now load dynamically and it’s insane that they didn’t somehow catch this. What it means in practical terms is that their spam/bot protection would decided halfway through a customer opening our website that we need to show captcha to this customer, but the captcha wouldn’t be served instead of index.html, but instead of some /foo/bar/users/data_about_me json request. 0/10 no notes Again, it wasn’t all bad, but it was always some bullshit. As is the custom with CDNs, at some point they decided that we’re profitable enough so they should jack up our prices 2x and upsell us something we didn’t need. Classic mafia behavior, but I’ve heard Cloudflare does the same. AMA I’ll answer as honestly as I can submitted by /u/catheap_games [link] [comments]

I am in the process of launching a niche web hosting service. I already have a group of committed clients lined up who specifically need shared hosting to create and manage a high volume of email accounts. The Use Case & Challenges: Heavy Load: The clients will be connecting their emails to third-party email campaign platforms. This means I’m expecting incredibly high server loads due to massive, concurrent IMAP and SMTP connections. Deliverability: The main goal is high inbox deliverability. To achieve this, I need a setup that allows me to assign different, clean IP addresses to different users/camps. Where I need your help: I am trying to figure out the right infrastructure before I buy anything. VPS vs. Dedicated Server: Given the heavy IMAP syncing, should I start with a high-end VPS or jump straight to a Dedicated Server? Which providers are friendly to email traffic (e.g., OVH, Hetzner, Leaseweb) and won’t block Port 25 instantly? IP Management: What is the best way to handle multi-IP outbound mail routing so one user’s spam doesn’t tank the IP of another? Software Stack: Which control panel (cPanel, DirectAdmin, CyberPanel) handles this kind of scale and IP rotation best? Estimated Costs: What should I realistically budget for monthly operational costs to get this running smoothly? If you have experience building high-volume mail servers, managing IP reputations, or if you already have this setup and are open to a technical partnership/collaboration to help me get this off the ground, please drop a comment submitted by /u/WhatsMueenUpto [link] [comments]

submitted by /u/tejas_bhalerao [link] [comments]