Sunday, May 2, 2021

System design: Binary large object - BLOB

 May 2, 2021

  1. Google: persistent values inside some databases - persistent values 
  2. Binary large objects - BLOB 

Binary large object

From Wikipedia, the free encyclopedia
Jump to navigationJump to search

A Binary Large OBject (BLOB) is a collection of binary data stored as a single entity. Blobs are typically images, audio or other multimedia objects, though sometimes binary executable code is stored as a blob. They can exist as persistent values inside some databases, or exist at runtime as program variables in some languages.

Blobs were originally just big amorphous chunks of data invented by Jim Starkey at DEC, who describes them as "the thing that ate Cincinnati, Cleveland, or whatever" from "the 1958 Steve McQueen movie",[1] referring to The Blob. Later, Terry McKiever, a marketing person for Apollo, felt that it needed to be an acronym and invented the backronym Basic Large Object. Then Informix invented an alternative backronym, Binary Large Object.[2]

The data type and definition was introduced to describe data not originally defined in traditional computer database systems, particularly because it was too large to store practically at the time the field of database systems was first being defined in the 1970s and 1980s. The data type became practical when disk space became cheap. This definition gained popularity with IBM's DB2.[citation needed]

The term is used in NoSQL databases, especially in key-value store databases such as Redis.[3][4] The term is also used by languages that allow runtime manipulation of Blobs, like JavaScript. [5]

The name "blob" is further borrowed by the deep learning software Caffe to represent multi-dimensional arrays.

In the world of free and open-source software, the term is also borrowed to refer to proprietary device drivers, which are distributed without their source code, exclusively through binary code; in such use, the term binary blob is common, even though the first letter in the blob abbreviation already stands for binary.

Other labels[edit]

Depending on the implementation and culture around usage, the concept might be alternately referred to as a "basic large object" or "binary data type".[6]

See also[edit]

References[edit]

  1. ^ Starkey, James. "The true story of BLOBs". Archived from the original on 23 July 2011.
  2. ^ Starkey, James. "The true story of BLOBs". email. Archived from the original on 23 July 2011. Retrieved 19 January 2006.
  3. ^ "BLOB Data in NoSQL". SSWUG.ORG. 17 October 2012.
  4. ^ Prusty, Narayan. "Storing Binary Data in Redis".
  5. ^ "File API specifications". w3c.github.io. W3C. Retrieved 23 February 2021.
  6. ^ "binary and varbinary (Transact-SQL)"."MySQL :: MySQL 5.0 Reference Manual :: 11.4.3 The BLOB and TEXT Types".

System design: System Properties Comparison Amazon DynamoDB vs. Microsoft Azure Cosmos DB

 May 2, 2021

Here is the link. 

Microsoft Azure Cosmos DB - 

DocumentDB API
Graph API (Gremlin)
MongoDB API
RESTful HTTP API
Table API


Our visitors often compare Amazon DynamoDB and Microsoft Azure Cosmos DB with MongoDB, Cassandra and Redis.

Editorial information provided by DB-Engines
NameAmazon DynamoDB  XMicrosoft Azure Cosmos DB info  X
DescriptionHosted, scalable database service by Amazon with the data stored in Amazons cloudGlobally distributed, horizontally scalable, multi-model database service
Primary database modelDocument store
Key-value store
Document store
Graph DBMS
Key-value store
Wide column store
Secondary database modelsSpatial DBMS
DB-Engines Ranking inforanking trend
Trend Chart
Score70.07
Rank#16  Overall
#2  Document stores
#2  Key-value stores
Score34.71
Rank#25  Overall
#3  Document stores
#2  Graph DBMS
#3  Key-value stores
#3  Wide column stores
Websiteaws.amazon.com/­dynamodbazure.microsoft.com/­services/­cosmos-db
Technical documentationdocs.aws.amazon.com/­dynamodbdocs.microsoft.com/­azure/­cosmos-db
DeveloperAmazonMicrosoft
Initial release20122014
License infocommercial infocommercial
Cloud-based only infoyesyes
DBaaS offerings (sponsored links) info
Server operating systemshostedhosted
Data schemeschema-freeschema-free
Typing infoyesyes info
Secondary indexesyesyes info
SQL infonoSQL-like query language
APIs and other access methodsRESTful HTTP APIDocumentDB API
Graph API (Gremlin)
MongoDB API
RESTful HTTP API
Table API
Supported programming languages.Net
ColdFusion
Erlang
Groovy
Java
JavaScript
Perl
PHP
Python
Ruby
.Net
C#
Java
JavaScript
JavaScript (Node.js)
MongoDB client drivers written for various programming languages
Python
Server-side scripts infonoJavaScript
Triggersyes infoJavaScript
Partitioning methods infoShardingSharding info
Replication methods infoyesyes info
MapReduce infono infowith Hadoop integration info
Consistency concepts infoEventual Consistency
Immediate Consistency info
Bounded Staleness
Consistent Prefix
Eventual Consistency
Immediate Consistency info
Session Consistency
Foreign keys infonono
Transaction concepts infoACID infoMulti-item ACID transactions with snapshot isolation within a partition
Concurrency infoyesyes
Durability infoyesyes
User concepts infoAccess rights for users and roles can be defined via the AWS Identity and Access Management (IAM)Access rights can be defined down to the item level

More information provided by the system vendor

We invite representatives of system vendors to contact us for updating and extending the system information,
and for displaying vendor-provided information such as key customers, competitive advantages and market metrics.

Related products and services
3rd partiesCData: Connect to Big Data & NoSQL through standard Drivers.
» more
CData: Connect to Big Data & NoSQL through standard Drivers.
» more

We invite representatives of vendors of related products to contact us for presenting information about their offerings here.

More resources
Amazon DynamoDBMicrosoft Azure Cosmos DB info
DB-Engines blog posts

Cloud-based DBMS's popularity grows at high rates
12 December 2019, Paul Andlinger

The popularity of cloud-based DBMSs has increased tenfold in four years
7 February 2017, Matthias Gelbmann

Increased popularity for consuming DBMS services out of the cloud
2 October 2015, Paul Andlinger

show all

Recent citations in the news

Triggering AWS Lambda Events with DynamoDB Integration
28 April 2021, hackernoon.com

Nosql Database Market Is Booming Worldwide | DynamoDB, ObjectLabs Corporation, Skyll – The Courier
24 April 2021, The Courier

ScyllaDB Announces SOC 2 Certification for NoSQL Database-as-a-Service
27 April 2021, StreetInsider.com

Global NoSQL Database Market Top Company Profile: DynamoDB, ObjectLabs Corporation, Skyll, MarkLogic, InfiniteGraph etc. – NeighborWebSJ
1 May 2021, NeighborWebSJ

Amazon Files get CRAB protection – Blocks and Files
14 April 2021, Blocks and Files

provided by Google News

Global NoSQL Databases Software Market 2020-2025 (Impact of Covid-19) | MongoDB, Amazon, ArangoDB, Azure Cosmos DB, Couchbase, MarkLogic, etc. – SoccerNurds
2 May 2021, SoccerNurds

Global Document Databases Software Market (2021) to Witness Huge Growth by 2026 | MongoDB, Amazon, ArangoDB, Azure Cosmos DB, Couchbase – KSU | The Sentinel Newspaper
29 April 2021, KSU | The Sentinel Newspaper

Document Databases Software Market Report 2020 : MongoDB, Amazon, ArangoDB, Azure Cosmos DB, Couchbase, MarkLogic, RethinkDB, CouchDB, SQL-RD, OrientDB, RavenDB, Redis
26 April 2021, Clark County Blog

Global NoSQL Databases Software Market Recent Trends, In-depth Analysis, Market Size Research Report Forecast up to 2025: MongoDB, Amazon, ArangoDB, Azure Cosmos DB, Couchbase – FLA News
16 April 2021, FLA News

NoSQL Software Market Information, Figures and Analytical Insights 2021– 2026 | MongoDB, OrientDB, Amazon, Azure Cosmos DB – The Courier
9 April 2021, The Courier

provided by Google News

Job opportunities

Software Development Engineer
Amazon Dev Centre Canada ULC, Vancouver

Co-Op Full-Stack Developer
Signiant Inc., Ottawa

Developer I
Live Nation, Quebec City

Software Developer, Fall 2021 Co-op
D2L, Kitchener

Software Development Engineer - AWS Payments
Amazon Dev Centre Canada ULC, Vancouver

Conseiller bilingue en infrastructure Azure / Consultant Bilingual Azure Infrastructure
Microsoft, Montréal

Application Architect (Azure / AWS)
DMI, Montréal

Software Developer
AccuV, Montréal

Java/J2EE Developer
RS Tec Systems Inc., Toronto

.Net Core Developer
Trillium Coast, Kleinburg

jobs by Indeed


System design: TOP FACEBOOK SYSTEM DESIGN INTERVIEW QUESTIONS (PART 2) | Design proximity server

 May 2, 2021

Here is the link. 



System design: Leetcode.com | Google system design questions | My 30 minutes study

May 2, 2021

I got this article from Leetcode. The link is here. 

 Hi Everyone, in my previous LeetCode post, I discussed five of the most frequent system design interview questions that I have collected by browsing through multiple websites like LeetCode, Blind, 1point3acre, etc. You can view them in this LeetCode article - https://leetcode.com/discuss/interview-question/1002218/top-facebook-system-design-interview-questions

In this post, I am summarizing another five of the frequent system design interview questions.
Thanks to the LeetCode community for helping me prepare for the interviews. I hope this post will benefit everyone in their interview prep. 🙂

Design Proximity Server

Proximity servers are used to discover nearby attractions such as places and events, which are then recommended to Facebook users.

  1. Users can add, update, and delete places.
  2. Given a location expressed as latitude and longitude, users can query all the nearby places within a given distance.
  3. Optional Follow-up: Query events near a given place around a particular time. This adds the third dimension of time to the problem.

Design Typeahead Suggestions

Google predicts and suggests a list of autocomplete queries based on the characters that we have already typed in the search box.

  1. Suggest the top ten search queries based on the characters already typed by the user in the search box.
  2. Assume query's popularity can be determined by the frequency of the query being searched in the past.

Design Privacy Settings at Facebook

We can set different privacy levels for the Facebook posts we publish to be only visible to a specific set of users like public, friends, friends of friends, etc.

  1. Enable a user to specify the different levels of privacy for a post so that it is only visible to a particular set of users.
  2. Implement two levels of privacy, Public and Friends.
  3. Optional Complex Levels: friends of friends, custom groups

Design Top N Songs

This question is very similar to designing the system for Top N Trending topics.

  1. Get the top N songs for a user over the past X days.
  2. Assume popularity of a song can be determined by the frequency of the song being listened to in the past.

Design Web Crawler

Web Crawler scans the world wide web to download and index all the web pages to be made available for the search queries submitted by the users.

  1. Given a list of seed web pages, it should download all the web pages and index them for future retrieval.
  2. The service should handle duplicate web pages so that unique URLs are stored.

Learn more about the design goals, scale estimations, high-level design overview, and detailed architecture diagram of these problems in this video - https://youtu.be/Hq8pZ8G2Lm8

Source: The article published on Dev.to: https://dev.to/theinterviewsage/top-facebook-system-design-interview-questions-part-2-1844

system designgoogledesignonsitefacebook system designfaangonsite-interviewfacebook interviewfacebook onsite roundfacebook

System design: Facebook system design | Search feature

May 2, 2021

Here is the link. 




System design: Facebook system design questions | instagram design

May 2, 2021

Here is the link. 











System design: TOP FACEBOOK SYSTEM DESIGN INTERVIEW QUESTIONS (PART 1) | User comment

 May 2, 2021

Here is the link. 



System design: TOP FACEBOOK SYSTEM DESIGN INTERVIEW QUESTIONS (PART 1) | News feed

 May 2, 2021

Here is the link. 


  • Client
  • Web Server
  • Load balancer
  • Application servers
  • NewsFeed Generation service
  • NewsFeed Ranking service 
  • User cache
  • Posts Cache
  • Media cache
  • User DB
  • Posts DB
  • Blob storage photos & Videos
  • NewsFeed Cache
  • Push Notification Servcie
  • Application servers
  • Load balancers
  • web servers
  • client -> getFeed-> web server -> load balancer -> Application servers -> newsFeedCache
  • CDN


System design: Leetcode.com | Facebook | Google | Top System Design Interview Questions (Part 1)

 May 5, 2021

I like to highlight and make myself a better reader. 

Facebook | Google | Top System Design Interview Questions (Part 1)
256
Anonymous User

Hi Everyone, I have browsed through multiple websites like LeetCode, Blind, Glassdoor, CareerCup, etc. to find the most frequent system design interview questions.


Due to the sheer volume of content, I have summarized the top questions so that I can share them with a large audience and everyone can benefit from them 🙂


And, thanks to the LeetCode community for helping me prepare for the interviews. I hope this will help everyone in their interview prep.

This is my first LeetCode post on system design interviews. Link to my second LeetCode post on this topic - https://leetcode.com/discuss/interview-question/1042229/Facebook-or-Top-System-Design-Interview-Questions-(Part-2)

Design Facebook Status Search

Facebook provides a search bar at the top of its page to enable its users to search posts, statuses, videos, and other forms of content posted by their friends and the pages they follow. In this question,

  1. Develop a service to enable the users to search the statuses posted on Facebook by their friends and followed pages.
  2. Consider that these statuses will only contain text for this particular question.

Design Live Commenting

This question is not related to Live Videos. This question is related to the active real-time feed of comments at the bottom of each post. Thus, in this question,

  1. Design the backend of a system that can enable real-time commenting on Facebook posts.
  2. The users should be able to see the new comments in real-time for the posts visible in front of their screen.

Design Facebook News Feed

In the Design Facebook News Feed question, design the following key features and their APIs.

  1. Facebook users should see the news feed containing posts and statuses from their friends and pages that they have followed.
  2. They can post and like statuses that may contain text, images, and videos.
  3. They can send friend requests to other users and follow other pages.

Design Facebook Messenger or WhatsApp

Develop the backend of a messenger system that can,

  1. Support 1:1 conversations between two users.
  2. Track the online or offline status of the users.

If time remains, discuss more complex features like Group conversations and Push notifications.


Design Instagram

Design a simpler version of Instagram.

  1. Users can upload and share photos.
  2. They can follow other users.
  3. Like the photos posted on Instagram.
  4. Instagram users should get a scrollable feed of photos that are posted by the users they follow.

Learn more about the design goals, scale estimations, high-level design overview, and detailed architecture diagram of these problems in this video - https://youtu.be/hykjbT5Z0oE

Source: The article published on Dev.to: https://dev.to/theinterviewsage/top-facebook-system-design-interview-questions-31np

system designgoogledesignonsitefacebook system designfaangonsite-interviewfacebook interviewfacebook onsite roundfacebook