Help! Is DevOps for me?

Hi,
I recently graduated with a Bachelor of Science in Engineering (computer technology). I got a job as a DevOps engineer with a focus on monitoring the company's application and infrastructure. I haven't got any experience or knowledge of a lot (any) of the tools, systems, and technology used. I often feel a bit lost during meetings, troubleshooting, and other tasks.
I've been at the company for 3 months and now they expect me to be able to take on features and stories all by myself, but I don't feel ready for it. For how long are you new at a job? Also, I'm going to be left alone in my team for some days this summer, responsible for everything to be up and running. They have never employed someone directly from uni, and the introduction hasn't been very thorough. I've mostly been attending online courses and haven't really done much “real work” yet. Also I'm suppose to onboard developer teams, but how can I when I don't master it myself?
I have told my boss and SM about me not feeling ready for all this responsibility and also asked for a more structured introduction, but they don't listen/care. All my other coworkers have worked 15+ years, in different areas and of course, I shouldn't compare myself to them, but I do.
What should I do? Is it possible for me to learn and become a good DevOps engineer even though I've “skipped” many steps and lack experience and knowledge? Or should I look for another job?
TIA!

https://redd.it/nmbu86
@r_devops

Has anyone ever used strongDM?

strongDM basically manages and audits access to infrastructure - we use strongDM at my company, just wondering if anyone else has any experience with it, or any thoughts on the product?

https://redd.it/nmayzn
@r_devops

The glut of new tech

New to DevOps and feeling a bit dizzy with everything on my plate.

We're considering Vault and Consul and are trying to peel off as much as we can from our VSphere and run it as K8s, but I'm not all that comfortable with K8s or these two Hashicorp tools.

What's your go to setup for trying to learn stuff out? Do you always run as K8s knowing that will be the end game or will you install it locally and get the hang of it first that way?

Juggling too many new things sounds counterproductive. Additionally, going and just using the Hashicorp HELM charts and running it that way makes the process to abstract and doesn't feel great for mastering a new tech stack.

https://redd.it/nljaku
@r_devops

Devops first steps

Hello Everyone!

Im working as a sys admin for almost a year, and worked as a network engineer for 3.
Any suggestions on how to enter the devops world? Courses? python?is my knowledge really relevant?

Please help me with some tips for a beginner, who wants to better understand what is devops and how to get the knowledge that would allow me to enter this world.


Thanks!!

https://redd.it/nmorve
@r_devops

Install logging agent (auditbeat) on multiple servers using a Rundeck job

Im looking for the most secure option to create a job that will install auditbeat (logging agent) on any server in my environment. My environment consists of windows and linux vms. Theres a couple of options im thinking of. For windows, Im using AD for auth so a powershell script should do the trick. For linux, would you recommend:

a. installing the rundeck server's ssh key on all vms? This way I can just run a simple bash script to install. This means i have to setup the node config in rundeck for about 30 vms. Seems very tedious

b. using ansible to communicate with all linux vms? I could create a hosts file but am not sure if this is the securest option.

​

Would you recommend any of these approaches or would you recommend something else and why?

https://redd.it/nmm6b0
@r_devops

No module named requests.exceptions - ansible / python error - job application tech test

Hi guys,

I hope all of you are doing very well!!

I was given a devops test for a devops position I applied for. It was a total of three tasks as follow:

\- Redis cluster.- RabbitMQ cluster.- MySQL cluster.

All of them over vagrant porvisioned with ansible.

I end up with this: https://github.com/rrodolfos/rrmd\_cluster, you could find all details, requirements and software versions that I used in the repo README.

Also I had it tested by a couple of friends. They tested in linux and one of them dares to try in Windows 7 (Yes, you did read right "seven"). The good thing was that everything runs smoothly and flawsless for them and for me.

The bad thing it apparently didn't work for the company I was applying for. They told me it wasn't a clean test and send me the following error:

TASK [rabbitmq_cluster : [rabbitmg_cluster role] Startingdocker_compose rabbitmq nodes] ***
fatal: [rabbitmq.cluster]: FAILED! => {"changed": false, "msg": "Failed to import the required Python library (Docker SDK for Python: dockerabove 5.0.@ (Python >= 3.6) or docker before 5.0.0 (Python 2.7) ordocker-py (Python 2.6) on rabbitmq's Python /usr/bin/python. Please read module documentation and install in the appropriate location. If the required library is installed, but Ansible is using the wrong Python interpreter, please consult the documentation on ansible_python_interpreter, for example via ‘pip install docker‘(Python >= 3.6) or ‘pip install docker==4.4.4‘ (Python 2.7) or ‘pipinstall docker-py’ (Python 2.6). The error was: No module namedrequests.exceptions"}

PLAY RECAP
*******************************************************************
rabbitmq.cluster : ok=10 changed=8 unreachable=0failed=1 skipped=0 rescued=0 ignored=0

Ansible failed to complete successfully. Any error output should bevisible above. Please fix these errors and try again.

The ugly thing is I was given no more information, that was it. Because I have no access to their environment I don't know which software versions they do have, which OS they were using, etc. I asked for that but I got no reply. I mean, I can't troubleshooting it and I really want to know what happened, what went wrong with the vagrant/ansible solution.

So I'm asking you guys if you could please clone that repo an just run those vagrant up and let me know your thoughts either way it works or it does not work. Maybe you can see the mistake I wasn't able to see. I really appreciate it if you take some time for this.

Thank you in advance, have a good day all of you and happy hacking!!!

RS

https://redd.it/nmlr23
@r_devops

Fluentd vs Logstash

Hi all, I'm currently doing some research on the logging solutions for our containerised applications. I came across Fluentd and Logstash. Some of the blogs suggests Fluentd to be lighter and thus better. Can I get some input on this topic please, if you have any kind of experience and if there are better solutions that I should be looking up on.

https://redd.it/nmk4zb
@r_devops

deploying python script output to AWS

Hi,

​

I currently have a python script that saves audio files locally in .mov format.

​

Desired outcome:

​

- I want to be able to store these files in a s3 bucket through my pyscript.
- I then want to take some data from the files and store it in AWS RDS database.
- If I can, I would like to make this all an API using API Gateway.


Is this possible? If so can anyone share some resources or tell me how to get started?

https://redd.it/nlie0b
@r_devops

Best Devops team to join in Sydney

I get a lot of messages from recruiters in LinkedIn - Devops is a really hot topic. I am also considering changing my job soon. Well paid at the current job, but lack meaningful work, tired of politics and not a healthy vibe in the team :(

So, I was wondering if Sydney Devops lads could brag about their job, their teammates and overall satisfaction from work.

I’d rather focus on getting the job I want than going through dozens of interviews and trying to guess if the interviewer hide unpleasant sides of the work.

https://redd.it/nldigv
@r_devops

My experience using AWS CDK #1

Hi Everyone,

Let me share with you my first experience using AWS CDK:

https://medium.com/@eilon.lotem/aws-cdk-route53-apigateway-lambda-cloudfront-flask-and-nuxt-a34f1ffdae80

Thank you!

https://redd.it/nlliza
@r_devops

New to cloud learning, a lot going over my head.

Hey all. I'm a graduate software developer trying to expand my cloud knowledge. I've passed the AZ900 exam and that was fairly straightforward. I have done a course for AZ204 (not done the exam) and despite learning a lot, a lot went over my head quite easily.

Does anyone have any good material for reading over/watching, for someone in my position? Any projects I could crack on with?

I do feel like a lot of it would come with experience based on a lot of people in the course being actual cloud engineers whereas I'm just trying to learn for now.

https://redd.it/nlewij
@r_devops

Top Back-End Frameworks to Explore in 2021

Some of the most popular backend frameworks of 2021.

I must say I wasn't totally wrong back in 2017.

https://hellboundbloggers.com/top-back-end-frameworks-to-explore/

https://redd.it/nlo4n5
@r_devops

DevOps in Production with Windows Workloads

Interested in hearing how you have moved traditional Enterprise environments to DevOps practices.

My organisation relies on software from a multitude of third parties which run on Windows with the usual .Net and MSSQL server stack.

While we don’t have the Development component of DevOps I do want to embrace IaaC and the other elements.

Containers aren’t on any of the supported environment lists. Terraform and Packer can probably get us a fair way forward (What about backups?) but keen to hear thoughts or experiences from others.

Note: Im using the AWS CDK for edge cases where we are doing Development or something new, it’s fantastic but sadly an edge case.

https://redd.it/nlcvfw
@r_devops

AWS DevOps Teacher

I am tired of online courses that are showing you always the default things and not related to real problems. I am a junior AWS engineer trying to learn more and more but its really hard sometimes. So i am looking for someone with Experience in AWS to teach me some stuff. Of course not for free. Please if you are really interested , DM .

Thanks in advance

https://redd.it/nmzi4d
@r_devops

Copying of thousands of small files is slow with AWS EFS

Our current workflow is that we prepare a Docker image with all the required files (thousands of small files related to composer packages and node modules) for the application and then run a Kubernetes job with the sole purpose of copying files from the container to the PV. Before using AWS EFS we used AWS EBS and the job completed in roughly 3 minutes. However, we scaled out and thus moved to AWS EKS for ReadWriteMany support.


The completion went from 3 minutes using EBS -> 20+ minutes using EFS. I also tried the Max I/O mode, but nothing really changed.


Are you aware of any configuration that could improve the performance?


I know, our workflow might not be perfect but it is what it is now...

https://redd.it/nmy79n
@r_devops

Semaphore, RunDeck and AWX Ansible

Hi folks,

I am going to manage the Ansible Playbook from GUI. Right now I am confuse which should I need to go with.

I just want to run the Ansible playbook from GUI and want to manage the inventory and task completed detail nothing else

Please let me know thanks in advance

https://redd.it/nmvo3p
@r_devops

Gitlab deployments on kubernetes

Hey Folks,

Need some suggestion on the GitLab authentication with the Kubernetes cluster. I have generated the kubeconfig file based on the token to authenticate GitLab for my deployments onto Kubernetes. However, when I try to deploy any objects via gitlab pipelines, it fails with the following error ?


gitlab runner console logs,
$ kubectl --kubeconfig=$QA_KUBECONFIG apply -f xyz/templates
unable to recognize "xyz1/templates/deployment.yaml": Unauthorized
unable to recognize "xyz2/templates/route.yaml": Unauthorized
unable to recognize "xyz3/templates/svc.yaml": Unauthorized


Able to auth and see the cluster objects from the local machine, using same KUBECONFIG used above for gitlab
$ kubectl get pods
No resources found in src-xyz-qa namespace


Using the working config file on my local on the GitLab as kubeconfig to authenticate the deployments, but not sure why it's failing? Does the kubeconfig that works on the local machine, doesn't work on GitLab? I am missing anything here?


Thank you so much.

https://redd.it/nmt489
@r_devops

Should we test Infra/provisioning/configs ?

That's a large topic so let's just put an open question. I would like to know your take on this.

I'm thinking of writing an article about this subject if I can't find what I need.

I've thought about it a lot (and still do), and read multiple articles relating this subject, and tried various libraries and methodology (TDD).

What do you think should be tested, and what's your rationale to test it (or not). Also, I would very like to hear about your personal/professional experience on that matter, and if/how rewarding/expensive the adoption was.

Thank you

https://redd.it/nmswb5
@r_devops

Monitoring multi-dyno Heroku app

Hello there.

I'm trying to set up some metrics monitoring on Heroku which would eventually be wired to Grafana Cloud. The formation on Heroku is multi-dyno (one web dyno running Rails and two dynos for some workers), with dynos potentially scaling up (especially web dyno).

I've gave a shot at setting up Prometheus, trying out different Ruby gems (discourse/prometheus\_exporter and prometheus/client\_ruby) but with no luck. The problem I'm facing is that dynos are isolated, so even both of these gems have multi process support, it just doesn't work on Heroku. E.g., the official Prometheus client has DirectFileStore
which writes to the same file on the filesystem so that different processes can write to it and then expose the same metrics when /metrics
is called. This doesn't work on Heroku because each dyno gets its own filesystem, so the file can't be shared.

Another option I've looked into potentially is using StatsD, but that will require running a deamon parallel with the Rails app or workers.

Was anyone in a similar situation before? Or do you use something totally different for your metrics for Heroku apps?

Thanks in advance!


P.S. I've posted the same question over at r/rails (link). Hope that doesn't violate any rules.

https://redd.it/nmscnc
@r_devops

Integrate Github with Rundeck

Is there a way to "natively" integrate github with Rundeck? Specifically, the 1st step of a job is to clone github repo to an inline script (step) so the job can always have the latest version of the script. Moreover, the code can live on github as opposed to an inline script (step) in Rundeck.

https://redd.it/nmsazg
@r_devops

Recommendations for Dashboard for Exec team and Business

Hi All,

Can this forum please recommend a reference architecture/implementation pattern for dashboard to measure Agile/DevOps metrics? We have just started on the journey and looking for something to measure where we are currently in a way that is easily visible to Business and the Exec Team.

Platform: Jira, Jenkins, Bitbucket Cloud, SVN (Some items will be migrated), k8s + Rancher, sonarqube On-Prem + Sonarcloud

**MVP:**

* Show completed stories within sprints tied into releases
* Show sonarqube stats for repositories
* Show commit metrics for sprints for repositories
* Read-only dashboard, no user input expected.

Things already considered:

* Hygieia
* Custom web app for dashboard using Angular, MongoDB etc. (likely more effort due to having to learn web development)
* DataDog

Anything else you guys can recommend? Leaning towards Hygieia, only issue is the lack of documentation.

https://redd.it/nn6e46
@r_devops