Ask HN: Does a dynamically scaling cloud workstation exist somewhere?
I frequently work with some 'data science' projects that go from some MB to hundreds of GB. Ideally I'd have a cloud terminal I'd connect to which could scale its RAM to fit my process RAM usage (and possibly scale up CPUs transparently too). I know that you can scale up various cloud instances, but managing the runtime state is a problem. I'd like to avoid ever having to kill whatever processes I have running. Something like Google's Live Migration would also be a good match here, if it enabled migrating to a bigger machine type without rebooting, or without otherwise losing process state. Ideally I'm looking for something that I could transparently scale up and down, and which I could always SSH into without having to manually start/shutdown the instances. Bonus points if GPUs could be added/removed in the same manner. 1 comments on Hacker News.
I frequently work with some 'data science' projects that go from some MB to hundreds of GB. Ideally I'd have a cloud terminal I'd connect to which could scale its RAM to fit my process RAM usage (and possibly scale up CPUs transparently too). I know that you can scale up various cloud instances, but managing the runtime state is a problem. I'd like to avoid ever having to kill whatever processes I have running. Something like Google's Live Migration would also be a good match here, if it enabled migrating to a bigger machine type without rebooting, or without otherwise losing process state. Ideally I'm looking for something that I could transparently scale up and down, and which I could always SSH into without having to manually start/shutdown the instances. Bonus points if GPUs could be added/removed in the same manner.
I frequently work with some 'data science' projects that go from some MB to hundreds of GB. Ideally I'd have a cloud terminal I'd connect to which could scale its RAM to fit my process RAM usage (and possibly scale up CPUs transparently too). I know that you can scale up various cloud instances, but managing the runtime state is a problem. I'd like to avoid ever having to kill whatever processes I have running. Something like Google's Live Migration would also be a good match here, if it enabled migrating to a bigger machine type without rebooting, or without otherwise losing process state. Ideally I'm looking for something that I could transparently scale up and down, and which I could always SSH into without having to manually start/shutdown the instances. Bonus points if GPUs could be added/removed in the same manner. 1 comments on Hacker News.
I frequently work with some 'data science' projects that go from some MB to hundreds of GB. Ideally I'd have a cloud terminal I'd connect to which could scale its RAM to fit my process RAM usage (and possibly scale up CPUs transparently too). I know that you can scale up various cloud instances, but managing the runtime state is a problem. I'd like to avoid ever having to kill whatever processes I have running. Something like Google's Live Migration would also be a good match here, if it enabled migrating to a bigger machine type without rebooting, or without otherwise losing process state. Ideally I'm looking for something that I could transparently scale up and down, and which I could always SSH into without having to manually start/shutdown the instances. Bonus points if GPUs could be added/removed in the same manner.
Hacker News story: Ask HN: Does a dynamically scaling cloud workstation exist somewhere?
![Hacker News story: Ask HN: Does a dynamically scaling cloud workstation exist somewhere?]()
Reviewed by Tha Kur
on
October 13, 2021
Rating:
No comments: