MongoDB
MongoDB is a cross-platform document-oriented database program. Classified as a NoSQL database program, MongoDB uses JSON-like documents with optional schemas. MongoDB is developed by MongoDB Inc. and licensed under the Server Side Public License (SSPL).
Developer(s) | MongoDB Inc. |
---|---|
Initial release | February 11, 2009[1] |
Stable release | 4.2.8[2]
/ 15 June 2020 |
Preview release | 4.4.0-rc9[3]
/ 27 May 2020 |
Repository | |
Written in | C++, Go, JavaScript, Python |
Operating system | Windows Vista and later, Linux, OS X 10.7 and later, Solaris,[4] FreeBSD[5] |
Available in | English |
Type | Document-oriented database |
License | Source-available |
Website | www |
History
10gen software company began developing MongoDB in 2007 as a component of a planned platform as a service product. In 2009, the company shifted to an open-source development model, with the company offering commercial support and other services. In 2013, 10gen changed its name to MongoDB Inc.[6]
On October 20, 2017, MongoDB became a publicly traded company, listed on NASDAQ as MDB with an IPO price of $24 per share.[7]
On October 30, 2019, MongoDB teamed up with Alibaba (NYSE:BABA) Cloud, who will offer its customers a MongoDB-as-a-service solution. Customers can use the managed offering from BABA's global data centers.[8]
Main features
Ad-hoc queries
MongoDB supports field, range query, and regular-expression searches.[9] Queries can return specific fields of documents and also include user-defined JavaScript functions. Queries can also be configured to return a random sample of results of a given size.
Indexing
Fields in a MongoDB document can be indexed with primary and secondary indices.
Replication
MongoDB provides high availability with replica sets.[10] A replica set consists of two or more copies of the data. Each replica-set member may act in the role of primary or secondary replica at any time. All writes and reads are done on the primary replica by default. Secondary replicas maintain a copy of the data of the primary using built-in replication. When a primary replica fails, the replica set automatically conducts an election process to determine which secondary should become the primary. Secondaries can optionally serve read operations, but that data is only eventually consistent by default.
Load balancing
MongoDB scales horizontally using sharding.[11] The user chooses a shard key, which determines how the data in a collection will be distributed. The data is split into ranges (based on the shard key) and distributed across multiple shards. (A shard is a master with one or more replicas.). Alternatively, the shard key can be hashed to map to a shard – enabling an even data distribution.
MongoDB can run over multiple servers, balancing the load or duplicating data to keep the system up and running in case of hardware failure.
File storage
MongoDB can be used as a file system, called GridFS, with load balancing and data replication features over multiple machines for storing files.
This function, called grid file system,[12] is included with MongoDB drivers. MongoDB exposes functions for file manipulation and content to developers. GridFS can be accessed using mongofiles utility or plugins for Nginx[13] and lighttpd.[14] GridFS divides a file into parts, or chunks, and stores each of those chunks as a separate document.[15]
Aggregation
MongoDB provides three ways to perform aggregation: the aggregation pipeline, the map-reduce function, and single-purpose aggregation methods.[16]
Map-reduce can be used for batch processing of data and aggregation operations. But according to MongoDB's documentation, the Aggregation Pipeline provides better performance for most aggregation operations.[17]
The aggregation framework enables users to obtain the kind of results for which the SQL GROUP BY clause is used. Aggregation operators can be strung together to form a pipeline – analogous to Unix pipes. The aggregation framework includes the $lookup operator which can join documents from multiple collections, as well as statistical operators such as standard deviation.
Server-side JavaScript execution
JavaScript can be used in queries, aggregation functions (such as MapReduce), and sent directly to the database to be executed.
Capped collections
MongoDB supports fixed-size collections called capped collections. This type of collection maintains insertion order and, once the specified size has been reached, behaves like a circular queue.
Editions
MongoDB Community Server
The MongoDB Community Edition is free and available for Windows, Linux, and OS X.[20]
MongoDB Enterprise Server
MongoDB Enterprise Server is the commercial edition of MongoDB, available as part of the MongoDB Enterprise Advanced subscription.[21]
MongoDB Atlas
MongoDB is also available as an on-demand fully managed service. MongoDB Atlas runs on AWS, Microsoft Azure, and Google Cloud Platform.[22]
Architecture
Programming language accessibility
MongoDB has official drivers for major programming languages and development environments.[23] There are also a large number of unofficial or community-supported drivers for other programming languages and frameworks.
Serverless access
MongoDB Stitch[24] provides serverless access to MongoDB and other services. Client libraries are available for JavaScript,[25] iOS,[26] and Android.[27]
Management and graphical front-ends
The primary interface to the database has been the mongo shell. Since MongoDB 3.2, MongoDB Compass is introduced as the native GUI. There are products and third-party projects that offer user interfaces for administration and data viewing.[28]
Licensing
MongoDB Community Server
As of October 2018, MongoDB is released under the Server Side Public License (SSPL), a license developed by the project. It replaces the GNU Affero General Public License, and is nearly identical to the GNU General Public License version 3, but requires that those making the software publicly available as part of a "service" must make the service's entire source code available under this license.[29][30] The SSPL was submitted for certification to the Open Source Initiative but later withdrawn.[31] The language drivers are available under an Apache License. In addition, MongoDB Inc. offers proprietary licenses for MongoDB. The last versions licensed as AGPL version 3 are 4.0.3 (stable) and 4.1.4.
MongoDB has been dropped from the Debian, Fedora and Red Hat Enterprise Linux distributions due to the licensing change. Fedora determined that the SSPL version 1 is not a free software license because it is "intentionally crafted to be aggressively discriminatory" towards commercial users.[32][33]
Bug reports and criticisms
Security
Due to the default security configuration of MongoDB, allowing anyone to have full access to the database, data from tens of thousands of MongoDB installations has been stolen. Furthermore, many MongoDB servers have been held for ransom.[34][35]
From the MongoDB 2.6 release onwards, the binaries from the official MongoDB RPM and DEB packages bind to localhost by default. From MongoDB 3.6, this default behavior was extended to all MongoDB packages across all platforms. As a result, all networked connections to the database will be denied unless explicitly configured by an administrator.[36]
Technical criticisms
In some failure scenarios where an application can access two distinct MongoDB processes, but these processes cannot access each other, it is possible for MongoDB to return stale reads. In this scenario it is also possible for MongoDB to roll back writes that have been acknowledged.[37] This issue was addressed since version 3.4.0 released in November 2016[38] (and back-ported to v3.2.12).[39]
Before version 2.2, locks were implemented on a per-server process basis. With version 2.2, locks were implemented at the database level.[40] Since version 3.0,[41] pluggable storage engines were introduced, and each storage engine may implement locks differently.[41] With MongoDB 3.0 locks are implemented at the collection level for the MMAPv1 storage engine,[42] while the WiredTiger storage engine uses an optimistic concurrency protocol that effectively provides document-level locking.[43] Even with versions prior to 3.0, one approach to increase concurrency is to use sharding.[44] In some situations, reads and writes will yield their locks. If MongoDB predicts a page is unlikely to be in memory, operations will yield their lock while the pages load. The use of lock yielding expanded greatly in 2.2.[45]
Up until version 3.3.11, MongoDB could not do collation-based sorting and was limited to byte-wise comparison via memcmp which would not provide correct ordering for many non-English languages when used with a Unicode encoding. The issue was fixed on August 23, 2016.
Prior to MongoDB 4.0, queries against an index were not atomic. Documents which were being updated while the query was running could be missed.[46] The introduction of the snapshot read concern in MongoDB 4.0 eliminated this phenomenon.[47]
Although MongoDB claims in an undated article entitled "MongoDB and Jepsen"[48] that their database passed Distributed Systems Safety Research company Jepsen's tests, which it called “the industry’s toughest data safety, correctness, and consistency Tests”, Jepsen published an article in May 2020 stating that MongoDB 3.6.4 had in fact failed their tests, and that the newer MongoDB 4.2.6 has more problems including “retrocausal transactions” where a transaction reverses order so that a read can see the result of a future write.[49][50]. Jepsen noted in their report that MongoDB omitted any mention of these findings on MongoDB's "MongoDB and Jepsen" page.
Prominent users
MongoDB is known to be used by Barclays; Bosch; Cisco; the City of Chicago; Codecademy; Coinbase; eBay; Foursquare; HSBC; IBM; Orange S.A.; Sega; The Gap, Inc.; Uber; Urban Outfitters; and U.S. Immigration and Customs Enforcement.[51][52]
MongoDB World
MongoDB World is an annual developer conference hosted by MongoDB, Inc.[53]
Year | Dates | City | Venue | Notes |
---|---|---|---|---|
2014 [54] | June 23–25 | New York | Sheraton Times Square Hotel | |
2015 [55] | June 1–2 | New York | Sheraton Times Square Hotel | |
2016 [56] | June 28–29 | New York | New York Hilton Midtown | |
2017 [57] | June 20–21 | Chicago | Hyatt Regency Chicago | First year not in New York City |
2018 [58] | June 26–27 | New York | New York Hilton Midtown | |
2019 [59] | June 17–19 | New York | New York Hilton Midtown | |
2020 [60] | May 4–6 | New York | New York Hilton Midtown | Canceled due to COVID-19 pandemic but was held entirely online as opposed to an in-person conference. |
See also
- Apache Cassandra
- BSON, the binary JSON format MongoDB uses for data storage and transfer
- List of server-side JavaScript implementations
- MEAN, a solutions stack using MongoDB as the database
- Server-side scripting
- TokuMX, a fork of MongoDB with stronger consistency and new index structures
References
- "State of MongoDB March, 2010". DB-Engines. Archived from the original on September 18, 2017. Retrieved July 5, 2017.
- "Release Notes for MongoDB 4.2 — MongoDB Manual". MongoDB. Retrieved June 17, 2020.
- "Release 4.4.0-rc9". MongoDB.
- "How to Set Up a MongoDB NoSQL Cluster Using Oracle Solaris Zones". Oracle. Archived from the original on August 12, 2017. Retrieved July 5, 2017.
- "How-To: MongoDB on FreeBSD 10.x". FreeBSD News. Archived from the original on December 28, 2017. Retrieved July 5, 2017.
- "10gen embraces what it created, becomes MongoDB Inc". Gigaom. Archived from the original on March 5, 2016. Retrieved January 29, 2016.
- Witkowski, Wallace (October 21, 2017). "MongoDB shares rally 34% in first day of trading above elevated IPO price". MarketWatch. Dow Jones. Archived from the original on February 26, 2018. Retrieved February 26, 2018.
- Betz, SA Editor Brandy (October 30, 2019). "MongoDB teams with Alibaba Cloud". Seeking Alpha. Retrieved October 31, 2019.
- Davis Kerby. "Why MongoDB is the way to go". DZone. Archived from the original on June 12, 2018. Retrieved July 6, 2017.
- "Ridiculously fast MongoDB replica recovery Part 1 of 2". ClusterHQ. Archived from the original on October 30, 2017.
- "Turning MongoDB Replica Set to a Sharded Cluster". Severalnines. Archived from the original on November 25, 2016.
- "GridFS & MongoDB: Pros & Cons". Compose. Archived from the original on September 10, 2017.
- "NGINX plugin for MongoDB source code". GitHub. Archived from the original on April 11, 2016. Retrieved September 10, 2016.
- "lighttpd plugin for MongoDB source code". Bitbucket. Archived from the original on August 7, 2011. Retrieved June 28, 2010.
- Malick Md. "MongoDB overview". Expertstown. Archived from the original on March 5, 2014. Retrieved February 27, 2014.
- "Aggregation — MongoDB Manual". docs.mongodb.com. Archived from the original on November 29, 2018. Retrieved August 14, 2018.
- "Map-Reduce — MongoDB Manual". docs.mongodb.com. Archived from the original on August 14, 2018. Retrieved August 14, 2018.
- "MongoDB Drives NoSQL More Deeply into Enterprise Opportunities". June 27, 2018. Archived from the original on August 7, 2018. Retrieved August 7, 2018.
- MongoDB 4.2.6
- "MongoDB Download Center". MongoDB. Archived from the original on August 14, 2018. Retrieved August 14, 2018.
- "MongoDB Download Center". MongoDB. Archived from the original on August 14, 2018. Retrieved August 14, 2018.
- "MongoDB launches Global Clusters to put geographic data control within reach of anyone". MongoDB. Archived from the original on June 27, 2018. Retrieved June 27, 2018.
- MongoDB. "GitHub - mongodb/mongo". GitHub. Archived from the original on July 29, 2017. Retrieved July 6, 2017.
- Simon Bisson. "MongoDB Stitch: Serverless compute with a big difference". ZDNet. Archived from the original on April 4, 2018. Retrieved September 13, 2018.
- MongoDB. "MongoDB Stitch JavaScript SDK". GitHub.
- MongoDB. "MongoDB Stitch iOS SDK". GitHub.
- MongoDB. "MongoDB Stitch Android SDK". GitHub.
- Ma, Jason. "Visualizing Your Data With MongoDB Compass". Dzone. Dzone.com. Archived from the original on May 22, 2018. Retrieved July 6, 2017.
- Baer, Tony. "It's MongoDB's turn to change its open source license". ZDNet. Archived from the original on October 31, 2018. Retrieved October 16, 2018.
- "MongoDB switches up its open source license". TechCrunch. Archived from the original on October 16, 2018. Retrieved October 16, 2018.
- Staff, Ars (October 16, 2019). "In 2019, multiple open source companies changed course—is it the right move?". Ars Technica.
- Vaughan-Nichols, Steven J. "MongoDB "open-source" Server Side Public License rejected". ZDNet. Archived from the original on January 16, 2019. Retrieved January 17, 2019.
- "MongoDB's licensing changes led Red Hat to drop the database from the latest version of its server OS". GeekWire. January 16, 2019. Archived from the original on January 17, 2019. Retrieved January 17, 2019.
- Krebs, Brian. "Extortionists Wipe Thousands of Databases, Victims Who Pay Up Get Stiffed". krebsonsecurity.com. Brian Krebs. Archived from the original on January 11, 2017. Retrieved January 11, 2017.
- Constantin, Lucian. "Ransomware groups have deleted over 10,000 MongoDB databases". Computer World. IDG. Archived from the original on January 10, 2017. Retrieved January 11, 2017.
- "MongoDB Bind IP Compatibility". MongoDB. MongoDB. Archived from the original on March 6, 2019. Retrieved March 5, 2019.
- Kyle Kingsbury (April 20, 2015). "Call me maybe: MongoDB stale reads". Archived from the original on August 15, 2015. Retrieved July 4, 2015.
- "Release Notes for MongoDB 3.4". MongoDB Manual. Archived from the original on August 14, 2018. Retrieved April 6, 2018.
- Kingsbury, Kyle (February 7, 2017). "MongoDB 3.4.0-rc3". Jepsen. Archived from the original on October 23, 2017.
- "Atomicity, isolation & concurrency in MongoDB". scalegrid.io. Archived from the original on September 10, 2017. Retrieved June 28, 2017.
- "MongoDB Goes Pluggable with Storage Engines". datanami.com. March 5, 2015. Archived from the original on July 4, 2017. Retrieved June 28, 2017.
- Arborian Consulting. "MongoDB, MMAPv1, WiredTiger, Locking, and Queues". Arborian Consulting. Archived from the original on June 19, 2017. Retrieved June 28, 2017.
- Kenny Gorman. "MongoDB 3.0 WiredTiger Compression and Performance". Objectrocket.com/. Archived from the original on June 16, 2017. Retrieved June 28, 2017.
- Mikita Manko. "MongoDB performance bottlenecks, optimization Strategies for MongoDB". mikitamanko.com. Archived from the original on July 19, 2017. Retrieved July 5, 2017.
- scalegrid.io. "Atomicity, isolation & concurrency in MongoDB". scalegrid.io. Archived from the original on September 10, 2017. Retrieved July 5, 2017.
- Glasser, David (June 7, 2016). "MongoDB queries don't always return all matching documents!". Meteor Blog.
- "MongoDB Docs". Archived from the original on March 6, 2019. Retrieved March 5, 2019.
- "MongoDB and Jepsen". MongoDB.
- Allen, Jonathan (May 22, 2020). "Jepsen Disputes MongoDB's Data Consistency Claims". InfoQ.
- Kingsbury, Kyle (May 15, 2020). "MongoDB 4.2.6". Jepsen.io.
- Esayas Aloto (November 4, 2015). "Who's Using MongoDB and Why?". Datavail. Archived from the original on November 12, 2018. Retrieved November 12, 2018.
- "Contract Summary". www.usaspending.gov. Retrieved March 29, 2020.
- "MongoDB World". www.mongodb.com. Archived from the original on April 26, 2019. Retrieved April 10, 2019.
- "Mongo 2014 Announcement". MongoDB.
- "Mongo 2015 Announcement". MongoDB.
- "Mongo 2016 Announcement". MongoDB.
- "Mongo 2017 Announcement". icrunchdata.
- "Mongo 2018 Retrospective". KenWalger.
- "Mongo 2019 Sneak Peek". MongoDB.
- "Mongo 2020 event". Eventil.
Bibliography
- Banker, Kyle (March 28, 2011), MongoDB in Action (1st ed.), Manning, p. 375, ISBN 978-1-935182-87-0
- Chodorow, Kristina; Dirolf, Michael (September 23, 2010), MongoDB: The Definitive Guide (1st ed.), O'Reilly Media, p. 216, ISBN 978-1-4493-8156-1
- Pirtle, Mitch (March 3, 2011), MongoDB for Web Development (1st ed.), Addison-Wesley Professional, p. 360, ISBN 978-0-321-70533-4
- Hawkins, Tim; Plugge, Eelco; Membrey, Peter (September 26, 2010), The Definitive Guide to MongoDB: The NoSQL Database for Cloud and Desktop Computing (1st ed.), Apress, p. 350, ISBN 978-1-4302-3051-9