Sometimes, the simplest solutions are the most effective. This applies to everyday life problems as well as technical ones.
Today, I’ll share a common challenge we faced at our newly developed platform, namastedev. This solution not only improved our application’s performance but also ensured a smoother experience for our users. So, take a few minutes to read through, as it’s bound to be worthwhile. And if you have any suggestions for improvement, feel free to share them with us.
Every day, thousands of students visit the namastedev platform to access video content on various tech topics. With both premium and non-premium content available, we partnered with a third-party service to secure our premium videos through DRM (Digital Rights Management) protection. This meant integrating their video player into our client-side, requiring users to obtain a special token from this service to access premium content.
Whenever a user clicked on a video, an API call is made to our server at “ourdomain.com/course/:courseSlug/:learningResSlug”. At the backend, we verify the user’s authentication and eligibility to watch the video. For premium content, we initiated a server call to the third-party DRM service to obtain a token, which was then forwarded to the user’s browser for video playback.
As depicted in the image above, the process involved a client requesting a token from namastedev’s server, which in turn requested it from the video Streaming Partner’s Server. This process incurred a delay, especially if network calls took time to reach our server, resulting in approximately 0.6 seconds to acquire a token.
While this setup was okay initially, later monitoring our API latency revealed that this particular API was slower than expected. Thus, our focus shifted to optimizing the latency for video watching APIs.
Excited by the prospect of enhancing user experience, we conceived the idea of a token pool. Although our streaming partner didn’t offer an API for token pooling, we decided to manage it internally. So we decided to manage an empty object in-memory, like so: let TOKEN_POOL = {}; and as soon as our node server starts, we call the initializeTokenPool() function. Within the initializeTokenPool() function, we maintain a hardcoded list of the most frequently watched video IDs. Furthermore, in this function, we fetch 100 tokens for each of the most commonly watched videos and save them into the TOKEN_POOL object. So, after the execution of initializeTokenPool(), our TOKEN_POOL looks something like this:
TOKEN_POOL = {
video_id_1: ['token1', 'token2', 'token3' ... 'token100'],
video_id_2: ['token1', 'token2', 'token3' ... 'token100'],
video_id_3: ['token1', 'token2', 'token3' ... 'token100'],
video_id_4: ['token1', 'token2', 'token3' ... 'token100'],
...
}
Now, the TOKEN_POOL contains tokens for the most commonly watched videos. When a user requests a token for a specific video, we first check our TOKEN_POOL for that video_id. If the video_id is found, we simply pop() a token and return it. However, if the video_id is not available in the TOKEN_POOL, we take two actions: first, we add that video_id to the TOKEN_POOL with an empty array (TOKEN_POOL[video_id] = []); second, we directly obtain a token from our video streaming partner and return it.
To ensure the token pool remained adequately stocked, we implemented a cron job to refill it every 5 minutes, maintaining a minimum of 100 tokens for each video.
Previously, it took about 0.6 seconds for a user to acquire a token to play the video. Now, with the token pool, users receive the token in just 0.04 seconds, as it’s readily available on our server without the need for an extra call.
After implementing this solution, we checked our latency graphs and were amazed with the results. Before the pool system, the average API latency was around 0.6 seconds. However, after implementation, it decreased dramatically to 0.04 seconds, marking a staggering 93.33% decrease. This significant improvement has undoubtedly enhanced the seamless experience for our users.
139 Comments
Such a good read , thank you for writing this.
Small Suggestion : if possible please add something like clap or likes. Which will motivate the publisher to publish more blogs and contenet and can also get the reactions of reader
1
Thanks for sharing this.. Again some new thing i learned here.
A small suggestion:- if possible make some video on these type of issue u resolved as a case study so we will have a deep dive.
It’s highly informative.
Small Suggestion : Could you please add bookmark feature so that we can save useful posts for future references.
Thanks akshay for the information. learned so much from you…..
1
@akshay, this solution is good but this solution will take up space in ram which will increase gradually also. Don’t you think so
Good day! Do you know if they make any plugins to help with SEO?
I’m trying to get my blog to rank for some targeted keywords but I’m not seeing very good results.
If you know of any please share. Appreciate
it! You can read similar text here: Eco bij
There are also extra workplace accidents (and of a more extreme nature) on the Mondays following the DST shift.
Your point of view caught my eye and was very interesting. Thanks. I have a question for you.
Hello there, I think your site could possibly be having web browser compatibility issues. When I look at your website in Safari, it looks fine however, when opening in Internet Explorer, it has some overlapping issues. I simply wanted to give you a quick heads up! Other than that, fantastic site.
Good article. I will be going through many of these issues as well..
Right here is the right site for anyone who wants to find out about this topic. You understand so much its almost tough to argue with you (not that I personally will need to…HaHa). You certainly put a new spin on a subject which has been discussed for a long time. Wonderful stuff, just wonderful.
The next time I read a blog, Hopefully it doesn’t fail me just as much as this one. I mean, Yes, it was my choice to read through, nonetheless I actually thought you would have something interesting to say. All I hear is a bunch of moaning about something you can fix if you were not too busy looking for attention.
A motivating discussion is definitely worth comment. I do think that you need to write more about this topic, it may not be a taboo matter but usually people don’t talk about such subjects. To the next! Cheers!
After I initially left a comment I seem to have clicked on the -Notify me when new comments are added- checkbox and now every time a comment is added I receive 4 emails with the exact same comment. There has to be a way you can remove me from that service? Thanks a lot.
This page truly has all the information I needed concerning this subject and didn’t know who to ask.
Your pets will love sleeping in the tent with you, and you may have more of an opportunity to do some hiking and get them some good exercise.
Hi there! I could have sworn I’ve visited this site before but after going through some of the posts I realized it’s new to me. Regardless, I’m definitely delighted I discovered it and I’ll be bookmarking it and checking back frequently.
Visakhapatnam is additionally known as Vizag and it really is one among the biggest towns of Andhra Pradesh.
It’ll enhance our stress ranges immensely, giving us a brand new perspective on the world that exists exterior our office lives.
Staff (April 27, 2020).
This is a topic which is close to my heart… Take care! Exactly where can I find the contact details for questions?
Pretty! This was a really wonderful article. Many thanks for providing this info.
It’s nearly impossible to find well-informed people on this subject, however, you sound like you know what you’re talking about! Thanks
I used to be able to find good info from your articles.
Everything is very open with a clear explanation of the challenges. It was really informative. Your website is very helpful. Thanks for sharing.
The very next time I read a blog, I hope that it doesn’t fail me just as much as this particular one. I mean, I know it was my choice to read, but I really believed you’d have something interesting to talk about. All I hear is a bunch of whining about something you could possibly fix if you were not too busy searching for attention.
An interesting discussion is worth comment. I believe that you need to write more about this issue, it might not be a taboo subject but usually folks don’t speak about such topics. To the next! Many thanks!
This is the right site for anybody who wants to find out about this topic. You realize so much its almost tough to argue with you (not that I personally will need to…HaHa). You definitely put a brand new spin on a subject which has been discussed for ages. Wonderful stuff, just excellent.
You should take part in a contest for one of the finest websites on the net. I most certainly will recommend this web site!
Way cool! Some extremely valid points! I appreciate you writing this post and the rest of the website is also really good.
His mom has by no means been identified, and Temple was positioned in foster care.
Han JM, Guo L, Chen XH, Xie Q, Track XY, Ma YL.
A fascinating discussion is worth comment. I do believe that you should publish more about this subject, it may not be a taboo matter but generally folks don’t discuss these subjects. To the next! Cheers!
Can I just say what a relief to discover a person that truly knows what they are talking about over the internet. You actually know how to bring an issue to light and make it important. A lot more people need to check this out and understand this side of the story. I was surprised you’re not more popular since you most certainly possess the gift.
You’ve made some really good points there. I checked on the net to find out more about the issue and found most people will go along with your views on this site.
My mother is an unbelievable piano participant, and she would break out this sheet music that seemed prefer it had ink spilled on it, the notes had been so clustered together.
Saved as a favorite, I really like your web site!
The primary Europeans to enter what would turn out to be Tennessee had been part of the expedition led by Hernando de Soto in the 16th century.
Next time I read a blog, I hope that it won’t disappoint me as much as this one. After all, I know it was my choice to read, nonetheless I really believed you would have something helpful to talk about. All I hear is a bunch of moaning about something you could fix if you weren’t too busy searching for attention.
I quite like looking through an article that will make men and women think. Also, thank you for allowing for me to comment.
Greetings! Very helpful advice in this particular post! It is the little changes that produce the biggest changes. Many thanks for sharing!
261. A lady is dressed in a large striped costume of black and gray with white lace cuffs; her companion is in a layered dress of mauve with black trim and a black lace shawl.
Hi, I do think this is an excellent web site. I stumbledupon it 😉 I will come back yet again since I saved as a favorite it. Money and freedom is the greatest way to change, may you be rich and continue to help others.
National Weather Service. National Oceanic and Atmospheric Administration.
I could not refrain from commenting. Well written!
It’s hard to find well-informed people for this topic, however, you sound like you know what you’re talking about! Thanks
In the 1980s Clarke was instrumental in bringing stained glass into the public sphere.
This second Augustine Washington family – together with George and his siblings – moved into a home on the Little Looking Creek plantation in 1735.
I blog quite often and I truly appreciate your content. Your article has truly peaked my interest. I will take a note of your blog and keep checking for new information about once per week. I opted in for your RSS feed too.
The target value is based on game consequence 1, 0.5, or 0, with 0.5 being a draw.
Everyone loves it when folks come together and share ideas. Great blog, keep it up.
Very good article. I will be dealing with many of these issues as well..
Score The match score after the aim was scored.
One example of the place our proto-mission concept was successful was in May 1998, when our milestone was to have prototypes of vital game programs in place and two take a look at maps working, on this case the White House and a part of Hong Kong.
Your style is very unique compared to other folks I have read stuff from. I appreciate you for posting when you’ve got the opportunity, Guess I will just bookmark this page.
Everything is very open with a clear explanation of the challenges. It was really informative. Your website is useful. Many thanks for sharing.
The National Weather Service office in Mount Holly, New Jersey, logged over 250 wind harm experiences within the region ensuing from the derecho, most ensuing from felled bushes and downed energy strains, a few of which collapsed on buildings and residences.
This web site truly has all the information I needed about this subject and didn’t know who to ask.
You created some decent points there. I looked online for any problem and discovered most individuals go in conjunction with together with your internet site.
Pretty! This was an incredibly wonderful article. Thank you for supplying this information.
I am really loving the theme/design of your website. Do you ever run into any internet browser compatibility issues? A few of my blog visitors have complained about my site not working correctly in Explorer but looks great in Safari. Do you have any tips to help fix this issue?
You can definitely see your enthusiasm within the paintings you write. The world hopes for even more passionate writers such as you who aren’t afraid to say how they believe. All the time follow your heart.
Oh my goodness! Impressive article dude! Thank you, However I am encountering problems with your RSS. I don’t know why I cannot join it. Is there anybody else getting similar RSS problems? Anyone that knows the solution will you kindly respond? Thanks!!
I quite like reading a post that will make men and women think. Also, many thanks for allowing me to comment.
Very good information. Lucky me I came across your blog by chance (stumbleupon). I have bookmarked it for later.
The comments here were just as instructive as your post
You make blogging look like a walk in the park! I’ve been trying to blog daily but I just cant find writing material.. you’re an inspiration to me and i’m sure many others!
I couldn’t resist commenting. Exceptionally well written.
Way cool! Some very valid points! I appreciate you writing this write-up and the rest of the site is extremely good.
Thanks a lot for sharing this with all people you really recognise what you’re speaking about! Bookmarked. Please also seek advice from my website =). We will have a hyperlink change agreement among us!
There is noticeably big money to understand this. I assume you’ve made specific nice points in functions also.
It’s appropriate time to make some plans for the future and it is time to be happy. I have read this post and if I could I wish to suggest you few interesting things or tips. Maybe you can write next articles referring to this article. I want to read more things about it!
I’m impressed, I must say. Rarely do I come across a blog that’s equally educative and entertaining, and let me tell you, you’ve hit the nail on the head. The issue is something that not enough men and women are speaking intelligently about. I am very happy that I came across this in my hunt for something concerning this.
I feel there’s a problem with your web site using Firefox browser.
This is the proper weblog for anyone who wishes to find out about this topic. You are aware of a lot its almost tricky to argue together with you (not that I actually would want…HaHa). You definitely put a whole new spin on the topic thats been discussing for several years. Excellent stuff, just fantastic!
I like what you guys are up also. Such clever work and reporting! Carry on the excellent works guys I have incorporated you guys to my blogroll. I think it will improve the value of my site .
You ought to be a part of a contest for one of the finest sites on the web. I am going to highly recommend this site!
Aw, this was an exceptionally good post. Taking the time and actual effort to produce a very good article… but what can I say… I procrastinate a whole lot and never manage to get nearly anything done.
Everything is very open with a clear description of the issues. It was truly informative. Your site is extremely helpful. Thank you for sharing.
I like this site very much, Its a really nice situation to read and get info .
Frank has been pretending not to receive his pension checks in order to talk with Sara, the customer service representative, on the phone.
hello I was very impressed with the setup you used with this website. I use blogs my self so good job. definatly adding to bookmarks.
Shame on you for creating another terrific post! Awesome stuff, keep up the good work. I see a lot of potential! I wonder if you are an active user with any social networking sites like Digg or Stumble Upon?
Crystalline panels when compared with various other semiconductors have got for a longer time everyday living.
Everyone loves it when people come together and share ideas. Great website, stick with it!
I seriously love your blog.. Pleasant colors & theme. Did you create this site yourself? Please reply back as I’m trying to create my very own site and want to learn where you got this from or what the theme is named. Thank you.
Your blog has the same post as another author but i like your better.*:~;’
Oh my goodness! an excellent post dude. Thanks a ton Nevertheless I am experiencing problem with ur rss . Do not know why Cannot enroll in it. Will there be everyone getting identical rss difficulty? Anyone who knows kindly respond. Thnkx
One of the more impressive blogs Ive seen. Thanks so much for keeping the internet classy for a change. Youve got style, class, bravado. I mean it. Please keep it up because without the internet is definitely lacking in intelligence.
Thanks for your writing. I would like to say a health insurance broker also works for the benefit of the actual coordinators of any group insurance policies. The health insurance broker is given a directory of benefits sought by an individual or a group coordinator. What any broker can is try to find individuals and also coordinators which best complement those requirements. Then he gifts his advice and if the two of you agree, the particular broker formulates a legal contract between the two parties.
Good day! This is kind of off topic but I need some help from an established blog. Is it very difficult to set up your own blog? I’m not very techincal but I can figure things out pretty fast. I’m thinking about setting up my own but I’m not sure where to begin. Do you have any ideas or suggestions? Cheers
Great website. You’ll discover several opinions on this matter and also this blog declares the matter quite fantastic.
Thanks for revealing your ideas. The first thing is that students have a solution between federal government student loan and a private student loan where it’s easier to go with student loan debt consolidation than through the federal education loan.
Have you considered about introducing some social bookmarking buttons to these blog posts. At least for facebook.
This is really fascinating, You are an overly skilled blogger. Ive joined your rss feed and stay up for looking for more of your great post. Also, Ive shared your website in my social networks!
Some really grand work on behalf of the owner of this web site , dead outstanding written content .
Great website. Plenty of helpful information here. I am sending it to some buddies ans additionally sharing in delicious. And certainly, thanks in your effort!
Everything is very open with a really clear clarification of the challenges. It was really informative. Your website is useful. Thanks for sharing.
Nonetheless, I hope it becomes more and more clear why the road, for a few of us, isn’t about “non-commercial” or “non-algorithmic,” however about Meta’s particular report of bloody horrors, and their absolute unwillingness to enact genuinely effective measures to forestall future political manipulation and individual suffering and loss on a global scale.
In January 2024, the company announced a partnership with Hidden Valley Ranch to introduce restricted-edition flavors together with regular ranch, buffalo sauce, crunchy celery, and contemporary carrot.
Stauffer: “Cora E Stauffer.-Her dwelling, Wilbur, WA.
Right here is the perfect webpage for anyone who wishes to understand this topic. You know so much its almost tough to argue with you (not that I actually would want to…HaHa). You definitely put a brand new spin on a subject which has been discussed for many years. Great stuff, just excellent.
Great post, you have pointed out some fantastic details , I too believe this s a very excellent website.
An impressive share, I merely with all this onto a colleague who was simply performing a little analysis on this. And then he in reality bought me breakfast because I uncovered it for him.. smile. So i want to reword that: Thnx to the treat! But yeah Thnkx for spending time to go over this, I’m strongly about it and love reading much more about this topic. If at all possible, as you grow expertise, might you mind updating your blog post with an increase of details? It’s highly great for me. Big thumb up due to this text!
Neat, book-marked sit down and may present to my personal freinds who also have an itchy vagina.
Pretty! This has been an extremely wonderful post. Thank you for supplying this info.
I am frequently to blogging and i also truly appreciate your posts. Your content has really peaks my interest. I am about to bookmark your web site and keep checking for brand spanking new details.
Can I merely say such a relief to find a person that actually knows what theyre speaking about over the internet. You definitely have learned to bring a challenge to light to make it essential. Lots more people need to check out this and appreciate this side on the story. I cant believe youre not more popular because you definitely have the gift.
I am linking this webpage from my private weblog . this has all of the usefull info necessary.
There may be jacksonville seo expert an easy method in making income without having being employed on your own ill along with devoid of the your complete moment. You can use the facility belonging to the Internet for you to earn more money and possess plenty of time to really love this website. Despite exactly how bit of you know about the World wide web or perhaps how much company encounter you’ve, you’ll be able to utilize a variety of fantastic prospects to generate capital suitable during your computer.
Thanks for the a new challenge you have exposed in your article. One thing I’d like to discuss is that FSBO human relationships are built as time passes. By releasing yourself to owners the first end of the week their FSBO is actually announced, prior to the masses begin calling on Thursday, you build a good relationship. By giving them equipment, educational components, free accounts, and forms, you become an ally. By taking a personal interest in them plus their scenario, you make a solid interconnection that, most of the time, pays off if the owners decide to go with a representative they know plus trust preferably you actually.
It’s an entry-level smartwatch geared toward remodeling the health experience for people who desires to prioritize their well being and effectively-being.
Excellent article! We will be linking to this particularly great post on our site. Keep up the good writing.
Way cool! Some very valid points! I appreciate you penning this post and also the rest of the website is also very good.
After I originally left a comment I seem to have clicked the -Notify me when new comments are added- checkbox and now whenever a comment is added I recieve 4 emails with the exact same comment. Is there an easy method you can remove me from that service? Appreciate it.
Thankses, I love my animals, you helped me much with taking care of him.
Founded in 1969, Owen affords six degrees: a typical 2-yr Master of Enterprise Administration (MBA), an Govt MBA, Grasp of Finance, Master of Accountancy, Grasp of Accountancy-Valuation, and Grasp of Management in Well being Care, in addition to quite a lot of joint professional and MBA diploma packages.
I blog frequently and I truly thank you for your content. Your article has really peaked my interest. I am going to take a note of your blog and keep checking for new information about once a week. I subscribed to your Feed too.
I seriously love your blog.. Great colors & theme. Did you build this amazing site yourself? Please reply back as I’m looking to create my own site and would love to learn where you got this from or just what the theme is called. Thanks!
He escaped years later, after assembly Ezra Bridger, whom he then compelled to help in locating Obi-Wan.
Can I simply say what a relief to find somebody that actually understands what they are talking about over the internet. You actually understand how to bring a problem to light and make it important. A lot more people have to check this out and understand this side of your story. I was surprised you aren’t more popular since you most certainly have the gift.
I like this – Gulvafslibning | Kurt Gulvmand , enjoyed this one thankyou for putting up keep update – Gulvafslibning | Kurt Gulvmand.
I apologise, but, in my opinion, you are not right. Let’s discuss. Write to me in PM, we will communicate.
You really should join in a contest for just one of the most useful blogs on-line. I’ll recommend this site!
I used to be able to find good advice from your articles.
ceramic floor tiles are the best, i used to have linoleum tiles but they do not last very long-
Great article mate, keep the great work, just shared this with ma friendz
An impressive share, I just now with all this onto a colleague who had been doing a little analysis with this. And he the fact is bought me breakfast simply because I discovered it for him.. smile. So let me reword that: Thnx for the treat! But yeah Thnkx for spending some time to discuss this, I’m strongly regarding it and really like reading regarding this topic. When possible, as you become expertise, does one mind updating your website with more details? It can be highly great for me. Massive thumb up for this short article!
Greetings! Very helpful advice in this particular post! It’s the little changes which will make the biggest changes. Thanks a lot for sharing!
I was able to find good information from your articles.
This is the perfect website for everyone who wishes to understand this topic. You know so much its almost tough to argue with you (not that I really would want to…HaHa). You certainly put a fresh spin on a topic that’s been discussed for many years. Wonderful stuff, just great.
This site certainly has all of the information I wanted concerning this subject and didn’t know who to ask.
Hello there! I simply would like to give you a huge thumbs up for the great information you have here on this post. I will be returning to your blog for more soon.
You made a number of nice points there. I did a hunt on the theme and found mainly persons can believe your blog.
This web-site is actually a walk-through you discover the knowledge you wished in regards to this and didn’t know who need to. Glimpse here, and you’ll certainly discover it.
Everything is very open with a precise clarification of the challenges. It was really informative. Your site is very useful. Many thanks for sharing.
hi. I observe you are focused on creating backlinks and stuff. I’m selling scrapebox auto approve lists. Do you want to trade ?