[–] 1 point 8 months ago

If they didn't have a friend helping them they would ask AI when they had setup issues. Quite a few of them said they wouldn't have been able to do it without the LLM.

They probably could have but it can be hard to sift through forum posts if you're new at something.

  • source
  • parent
  • context
  • [–] [S] 1 point 8 months ago

    The team is spread out around the world, so going on site it really only feasible for me and a guy whose son lives in the same city.

    As for what we’re trying to lab… first thing is large scale HPC/AI deployments. Starting with a model of the customer only wanting us to stand up, validate, burn in, and wipe as many racks at a time as possible. Right now we’re looking at a small deployment server that can connect to whatever network is needed and run our management software. Probably looking at some kind of automation for the networking as well. Why don’t we do that in manufacturing, you ask? There are some political reasons some of the stuff wouldn’t get done, but customers change their minds while hardware is in transit a lot! Also, stuff breaks and shimmies loose in transit all the time!

    After that, we can look at our smaller deployments and see where we can automate things. Also looking to test/evaluate products so we can add to our delivery portfolio.

  • source
  • parent
  • context
  • [–] [S] 2 points 8 months ago

    Hello, I'm back after trying. The g+s permission does not change group permissions when copying a file. However, I have observed that I can delete copied files even though those are 630 and supposedly I should not be able to modify them. That is good enough for me: as long as I can delete the stuff it's ok, if I need to modify I can always copy it somewhere else.

  • source
  • parent
  • context
  • [–] 1 point 8 months ago

    No web ui, just the direct CLI interface.

    For my team, I have set up lab accounts on the host machine and configured the SSHD daemon to drop them directly into their designated lab container when they use that account and key combo.

    Nothing fancy.

  • source
  • parent
  • context
  • [–] 2 points 8 months ago (1 child)

    What are you trying to lab? I would virtualize as much as possible, but that only gets you so far. You can't really virtualize appliances or hardware like infiniband connections.

    You might just set up a whole day once a month to go in and run a class on setting up one kind of environment, then give them a few weeks to play around, break it, tear it down, and rebuild it.

  • source
  • [–] 2 points 8 months ago* (2 children)

    I'm currently in the process of deploying a Linux lab environment at my current workplace actually.

    Check out Incus if you haven't already. Incus Containers

    It's a community supported fully open source fork of LXC. It supports full system Linux containers as opposed to Docker-style single application containers. It also supports full QEMU virtual machines of you need them.

    It's likely going to replace my entire traditional type-1 hypervisor setup in my home lab because of how much lighter weight it is. My most lightweight VMs are typically still 2GB of RAM, things tend to get funky when I go below that. Whereas my clean install of a Debian 13 container on Incus was using around 90MB. In these crazy times, anything that uses RAM 10x-20x more efficiently has my attention.

    It can also do all the typical hypervisor back end stuff, HA clustering, automatic container snapshots, userspace isolation, virtual networking, static and dynamic resource limitations, etc.

    The daemon runs on all major distros, but you can also build and use their IncusOS, which is an immutable distro-fied Incus deployment that is optimized out of the box. (Although I've had great results just running it as a daemon on a basic Debian installation.)

    It's super easy to learn and get going, and it's working perfectly in the early tests for my team as a Lab environment platform.

  • source
  • I (plus friends who do something similar) have been using centralized auth systems for this stuff. Proxmox supports OIDC, so if you are using Authentik or something similar you can just use one password.

    And then Authentik supports 2FA, so you can use TOTP with that, or use passwords only.

  • source
  • parent
  • context
  • [–] [S] 1 point 8 months ago (1 child)

    We actually use Redmine on another server that doesn’t require the VPN (still requires login though). Figured that would probably be a decent place for that stuff. Won’t be posting any passwords there! Initial access to the cluster will be key-based.

  • source
  • parent
  • context
  • [–] 1 point 8 months ago

    Your use case is not the one that is making our lives more difficult. Using an LLM to do something for yourself, without passing it on to someone else as some sort of value add or using it as a way to get around having to think for yourself, is not the use case that we are against. Forcing a DEVELOPER to use it in their job for everything possible means that the developer does not learn, does not gain skills, and does not do the thing that they assumedly started learning how to code for. The only thing they learn is how to write a prompt (which isn't fun) and how to clean up after the AI (which is even less fun). Coding is fun! It's like a giant ever-changing puzzle! I don't want to hand all the fun parts of my job over to a plagiarism machine that is making life materially worse for a majority of the world!

  • source
  • parent
  • context
  • [–] 1 point 8 months ago

    You’re suggesting that we replace THEM with an agent.

    I am not suggesting we replace anyone, least of all the open source community, so let's not put words in my mouth

    I think the current code I see being generated is generally “good enough”. I’m not comparing it to perfect: I’m comparing it to people.

    If this were true, then open source projects would have much less of an issue with pull requests from sloperators.

    This doesn't follow to me. A good tool in the hand of a crappy user doesn't suddenly make good output. I specifically said that LLMs write good code in a specific setting. Clearly random person generating thousands of lines at a time for a project they don't understand isn't that setting.

    You seem to be very focused on crappy code generated by people that don't know what they're doing, the technology isn't good enough for that, so yes, it won't work in that setting, I agree.

  • source
  • parent
  • context
  • [–] [S] 0 points 8 months ago

    I'm grateful for all the help and advice in here. Duplicating the data is not a problem, we can have several copies of the data on the server, not an issue.

    Having the data on an external server on the other hand may be a problem, because that would require quite a large amount of storing capacity.

    I'm unsure what you mean by accessing on demand: data already is on the server and people can access it. My main pain point is that if people copy stuff in there rather than creating it in place I do not get write access by default.

    The copy party software looks interesting for other applications, and I may pick it up for something else, but it is not something that would work in this case. As I have explained extensively, while spawning a file server would not be impossible, it would be a huge hassle with no real advantages.

  • source
  • parent
  • context
  • [–] [S] 0 points 8 months ago (2 children)

    I didn't fully understand what this software does, but it looks pretty neat. However, regardless of what it does, this is not something that I could use in my case. This spawns a server and I imagine it can do it's thing only as long as the server is running. Which in my case it would be around 8 hours which is the login session time limit on the HPC. Moreover, I'd be running a potentially resource hungry process on a login server, which is a big problem. I could request a compute job and run this there I guess, but this would still be limited by the queue max time. Moreover, while not impossible, the login node to login node communication would be a pain in the ass. I'd have to either always connect to the same node to spawn it or to let everyone know of the IP the server is currently running on. And I'd have to do this manually every 8 hours. It is feasible, but this is probably a better software for other kinds of problems.

  • source
  • parent
  • context
  • [–] [S] 0 points 8 months ago (4 children)

    Not strictly about compliance, setting up FTP or WebDAV is technically complex without root access. You'd have to account for the fact that sessions on a HPC are time limited. Probably you can come up with some workaround that way, but I'm not sure that is any better than my current setup.

  • source
  • parent
  • context
  • view more: ‹ prev next ›