You read the title of the blog, it’s clear enough what we are here for. Understanding Serverless the easiest way possible. If what you read below is too slow for your pace. You can jump right into a more practical, hands-on learning experience where I build a party parrot GIF generator from scratch and deployed it over on serverless. The link at the end, or probably on the sidebar.(more…)
If you have found this blog on the internet, I assure you this problem of yours gets solved here and now once and for all.(more…)
Hey future Vipul, this is Vipul from 2020. What you know is a drop, what you don’t know is an ocean. You will need this guide when you get a new machine pre-installed with Windows (Whatever latest version is there on the planet you live on). Hopefully, Linux also exists at that time and you want to escape through a dual boot to loving arms of open-source software. You can’t go full Linux because you occasionally use proprietary tools and like gaming on Windows. We will be going through prep for that, to lighten Windows up to run on bare-minimum before the dual boot. Let’s get started, we have a lot to cover.(more…)
This is the start of mini posts that I will be writing every week about whatever the week has been about and what hasn’t it been. Your boi is a hard working, employed boi so probably 3000 words long essay style blogs will become a thing of the past and I will learn to compress information down to really important bits for once in 2020. We just lost Irfan Khan. I am not sure I am handling it all too well. Nonetheless, we carry on against the droning deafening hollow of life.(more…)
Graphite is an enterprise-ready infrastructure monitoring solution which can plug into existing infrastructure and solve the problems of time-series data storage, performance measurement, and data visualization. It is easily deployed as a platform for the Cloud and On-Prem. It is a mature and reliable open source monitoring solution solving monitoring issues for numerous large companies. With an extensive amount of integrations and tools available, Graphite can be modified to serve your needs from different storage backend’s, data collection agents, visualization tools, anomaly detection and alerting.(more…)
Busy servers and applications have a lot of things to monitor and there are stats in several forms. The stats are regarding your servers, applications running on those servers and loads of metrics which needs to be collected and monitored properly. Processing and collecting these stats help in deciding factors like scaling, performance of the system, troubleshooting and among more in your configuration. For monitoring to be precise, the system needs loads of data and the amount of data collected will likely increase the chances of understanding what is happening at any point of time. In this blog, we will be placing two popular collection programs StatsD and CollectD head to head to see what works in diverse use cases, and listing their pros and cons. Let’s go over why StatsD and CollectD are called daemons.(more…)
As soon as one hears about, Kubernetes or K8’s. The minds of some people run off to faraway lands as to what this complex piece of technology really is. With this post, I will give my best to bring forth some unique clarity on the subject with the help of my favorite sitcom, The Office. This is for people who basically know nothing, know very little or should know nothing about the technology but still want to know what the hype is about. It’s for everyone. Also, a bit of a disclaimer.Let’s Go!
Smallest and probably the fastest solution(s) for the problem stated above.(more…)
Even though Microsoft loves Linux now, the “love” kind of dries up when you start to think about downloading a OneDrive client for your favorite Linux distro, and end up finding that there is no real client out there that fulfills your needs. I needed an all in one solution for securely syncing my files to OneDrive without worrying about losing them.
Some time back, Vipul on Mixster wrote an awesome review about the all-in-one solution for your Google Drive client troubles for Linux that Insync solves. Here, we are following up with Insync contacting us to write another review for them on their new OneDrive Linux client. Long story short, it changed my mind about using OneDrive web as my standard way of accessing my file, to now using Insync’s awesome OneDrive client. Here’s a small review of how I found it to be really useful! Let’s get started.(more…)
Youtube runs thousands of servers and streams videos to millions of viewers. We assume a server to be a single physical machine rather they are part of many virtual machines running on top of a single physical machine across the thousands of computers in a data center. Wanna know more about them. Click –>(more…)
Well, as far as the flow goes CerberusValidator works with schemas that are in Mapping structure. Basically any dicts with values as dict having types of values. If you don’t get it, then check this out https://docs.python-cerberus.org/en/stable/
But, Cerberus only cares for the schema and data which it’s getting from the user. Not from where it gets it. Almost most of our users will be giving the schema in the form either URL or paths to files. Which is fine by us until the point somewhere in week 12 where I forgot to code that properly into the code. Nothing to be afraid had to redo some old functions. Actually improved a lot of old code in the process. How time flies by. Damn.
Not much is left to be done, except write a few more tests and a lot of testing. And merging it to master. I am confident we can make it before August 19. Let’s see. Fingers crossed. This is vipulgupta2048 signing off for the second last time here. I won’t be going anywhere if you think.
There is a lot of work to be done at ScrapingHub x The Scrapy Project.
Looking forward to new challenges.
Next, final work report!
Week #10 24/07 to 30/07
The integration finally worked, and a completely unrelated banner!!(more…)
Week #9 17/07 to 23/07
Well, integration isn’t working, and I am not giving up.