This is the start of mini posts that I will be writing every week about whatever the week has been about and what hasn’t it been. Your boi is a hard working, employed boi so probably 3000 words long essay style blogs will become a thing of the past and I will learn to compress information down to really important bits for once in 2020. We just lost Irfan Khan. I am not sure I am handling it all too well. Nonetheless, we carry on against the droning deafening hollow of life.(more…)
Graphite is an enterprise-ready infrastructure monitoring solution which can plug into existing infrastructure and solve the problems of time-series data storage, performance measurement, and data visualization. It is easily deployed as a platform for the Cloud and On-Prem. It is a mature and reliable open source monitoring solution solving monitoring issues for numerous large companies. With an extensive amount of integrations and tools available, Graphite can be modified to serve your needs from different storage backend’s, data collection agents, visualization tools, anomaly detection and alerting.(more…)
Busy servers and applications have a lot of things to monitor and there are stats in several forms. The stats are regarding your servers, applications running on those servers and loads of metrics which needs to be collected and monitored properly. Processing and collecting these stats help in deciding factors like scaling, performance of the system, troubleshooting and among more in your configuration. For monitoring to be precise, the system needs loads of data and the amount of data collected will likely increase the chances of understanding what is happening at any point of time. In this blog, we will be placing two popular collection programs StatsD and CollectD head to head to see what works in diverse use cases, and listing their pros and cons. Let’s go over why StatsD and CollectD are called daemons.(more…)
As soon as one hears about, Kubernetes or K8’s. The minds of some people run off to faraway lands as to what this complex piece of technology really is. With this post, I will give my best to bring forth some unique clarity on the subject with the help of my favorite sitcom, The Office. This is for people who basically know nothing, know very little or should know nothing about the technology but still want to know what the hype is about. It’s for everyone. Also, a bit of a disclaimer.Let’s Go!
Smallest and probably the fastest solution(s) for the problem stated above.(more…)
Even though Microsoft loves Linux now, the “love” kind of dries up when you start to think about downloading a OneDrive client for your favorite Linux distro, and end up finding that there is no real client out there that fulfills your needs. I needed an all in one solution for securely syncing my files to OneDrive without worrying about losing them.
Some time back, Vipul on Mixster wrote an awesome review about the all-in-one solution for your Google Drive client troubles for Linux that Insync solves. Here, we are following up with Insync contacting us to write another review for them on their new OneDrive Linux client. Long story short, it changed my mind about using OneDrive web as my standard way of accessing my file, to now using Insync’s awesome OneDrive client. Here’s a small review of how I found it to be really useful! Let’s get started.(more…)
Youtube runs thousands of servers and streams videos to millions of viewers. We assume a server to be a single physical machine rather they are part of many virtual machines running on top of a single physical machine across the thousands of computers in a data center. Wanna know more about them. Click –>(more…)
Well, as far as the flow goes CerberusValidator works with schemas that are in Mapping structure. Basically any dicts with values as dict having types of values. If you don’t get it, then check this out https://docs.python-cerberus.org/en/stable/
But, Cerberus only cares for the schema and data which it’s getting from the user. Not from where it gets it. Almost most of our users will be giving the schema in the form either URL or paths to files. Which is fine by us until the point somewhere in week 12 where I forgot to code that properly into the code. Nothing to be afraid had to redo some old functions. Actually improved a lot of old code in the process. How time flies by. Damn.
Not much is left to be done, except write a few more tests and a lot of testing. And merging it to master. I am confident we can make it before August 19. Let’s see. Fingers crossed. This is vipulgupta2048 signing off for the second last time here. I won’t be going anywhere if you think.
There is a lot of work to be done at ScrapingHub x The Scrapy Project.
Looking forward to new challenges.
Next, final work report!
Week #10 24/07 to 30/07
The integration finally worked, and a completely unrelated banner!!(more…)
Week #9 17/07 to 23/07
Well, integration isn’t working, and I am not giving up.
Week #8 10/07 to 16/07
I just realized that there aren’t many weeks left. Good times like these should never end.
Week #7 03/07 to 09/07
Week #6 26/06 to 02/07
Well, I survived the first evaluation as you can all see. Made some mistakes along the way, recovered with the advice from my mentors and hopefully going strong into work period 2. Let’s talk shop, yes.
Week #5 19/06 to 25/06
The first evaluation is here, got done with a milestone and took a small break for a personal event.
Week #4 12/06 to 18/06
Well, this has been another rather testing week.
Week #3 5/06 to 11/06
If the distance is the path traveled between 2 points and displacement between 2 points is the shortest path you can take to reach your destination from the initial point.
Then, I say after making full circles, my overall displacement is 0. But, I am sure as hell has come a long way in learning more about Python as a programming language by just reading and understanding and implementing new code concepts than ever before.
Week #2 – 28/05 to 04/06
Well, this has been a good week of learning about new things, revising old concepts and reading implementation of one of the oldest modules in Python to understand the idea behind Python Packaging. I feel bad about not able to write a lot of code, but I think without understanding the existing code base the way forward would have been fruitless, and more disappointing.
So, let’s start by answering our 3 infamous questions and later give you a broad picture into Python Packaging as I will try to explain it to you like a 5-year-old.
Week #1 – 21/05 to 27/05
In the last meeting, my mentors and I decided upon the mini-project that I suggested. Here’s a brief overview of what I decided to work with over the course of the last week.