Project Jupyter

Project Jupyter (/ˈpɪtər/ (listen)) is a nonprofit organization created to "develop open-source software, open-standards, and services for interactive computing across dozens of programming languages". Spun-off from IPython in 2014 by Fernando Pérez, Project Jupyter supports execution environments in several dozen languages. Project Jupyter's name is a reference to the three core programming languages supported by Jupyter, which are Julia, Python and R, and also a homage to Galileo's notebooks recording the discovery of the moons of Jupiter. Project Jupyter has developed and supported the interactive computing products Jupyter Notebook, JupyterHub, and JupyterLab, the next-generation version of Jupyter Notebook.

Project Jupyter
AbbreviationJupyter
FormationFebruary 2015 (2015-02)
Typenonprofit organization
PurposeTo support interactive data science and scientific computing across all programming languages.[1]
Region served
Worldwide
Official language
English
Websitejupyter.org

History

In 2014, Fernando Pérez announced a spin-off project from IPython called Project Jupyter.[2] IPython continues to exist as a Python shell and a kernel for Jupyter, while the notebook and other language-agnostic parts of IPython moved under the Jupyter name.[3][4] Jupyter is language agnostic and it supports execution environments (aka kernels) in several dozen languages among which are Julia, R, Haskell, Ruby, and of course Python (via the IPython kernel).[5]

In 2015, GitHub and the Jupyter Project announced native rendering of Jupyter notebooks file format (.ipynb files) on the GitHub platform.[6][7]

Philosophy

Project Jupyter's operating philosophy is to support interactive data science and scientific computing across all programming languages via the development of open-source software. According to the Project Jupyter website, "Jupyter will always be 100% open-source software, free for all to use and released under the liberal terms of the modified BSD license".[1]

Products

Jupyter Notebook

Jupyter Notebook (formerly IPython Notebooks) is a web-based interactive computational environment for creating Jupyter notebook documents. The "notebook" term can colloquially make reference to many different entities, mainly the Jupyter web application, Jupyter Python web server, or Jupyter document format depending on context. A Jupyter Notebook document is a JSON document, following a versioned schema, and containing an ordered list of input/output cells which can contain code, text (using Markdown), mathematics, plots and rich media, usually ending with the ".ipynb" extension.

A Jupyter Notebook can be converted to a number of open standard output formats (HTML, presentation slides, LaTeX, PDF, ReStructuredText, Markdown, Python) through "Download As" in the web interface, via the nbconvert library or "jupyter nbconvert" command line interface in a shell. To simplify visualisation of Jupyter notebook documents on the web, the nbconvert library is provided as a service through NbViewer which can take a URL to any publicly available notebook document, convert it to HTML on the fly and display it to the user.

Jupyter Notebook interface

Jupyter Notebook provides a browser-based REPL built upon a number of popular open-source libraries:

Jupyter Notebook can connect to many kernels to allow programming in many languages. By default Jupyter Notebook ships with the IPython kernel. As of the 2.3 release[8][9] (October 2014), there are currently 49 Jupyter-compatible kernels for many programming languages, including Python, R, Julia and Haskell.[10]

The Notebook interface was added to IPython in the 0.12 release[11] (December 2011), renamed to Jupyter notebook in 2015 (IPython 4.0 – Jupyter 1.0). Jupyter Notebook is similar to the notebook interface of other programs such as Maple, Mathematica, and SageMath, a computational interface style that originated with Mathematica in the 1980s.[12] According to The Atlantic, Jupyter interest overtook the popularity of the Mathematica notebook interface in early 2018.[12]

Jupyter kernels

A Jupyter kernel is a program responsible for handling various types of requests (code execution, code completions, inspection), and providing a reply. Kernels talk to the other components of Jupyter using ZeroMQ over the network, and thus can be on the same or remote machines. Unlike many other Notebook-like interfaces, in Jupyter, kernels are not aware that they are attached to a specific document, and can be connected to many clients at once. Usually kernels allow execution of only a single language, but there are a couple of exceptions.

JupyterHub

JupyterHub[13] is a multi-user server for Jupyter Notebooks. It is designed to support many users by spawning, managing, and proxying many singular Jupyter Notebook servers. While JupyterHub requires managing servers, third-party services like Jupyo[14] provide an alternative to JupyterHub by hosting and managing multi-user Jupyter notebooks in the cloud.

JupyterLab

JupyterLab is the next-generation user interface for Project Jupyter. It offers all the familiar building blocks of the classic Jupyter Notebook (notebook, terminal, text editor, file browser, rich outputs, etc.) in a flexible and powerful user interface. The first stable release was announced on February 20, 2018.[15]

Industry adoption

The Jupyter Notebook has become a popular user interface for cloud computing, and major cloud providers have adopted the Jupyter Notebook or derivative tools as a frontend interface for cloud users. Examples include Amazon's SageMaker Notebooks,[16] Google's Colaboratory[17] and Microsoft's Azure Notebook.[18]

Colaboratory

Colaboratory (also known as Colab) is a free Jupyter notebook environment that runs in the cloud and stores its notebooks on Google Drive. Colab was originally an internal Google project; an attempt[19] was made to open source all the code and work more directly upstream, leading to the development of the "Open in Colab" Google Chrome extension,[20] but this eventually ended, and Colab development continued internally. As of October 2019, the Colaboratory UI only allows you to create notebooks with Python 2 and Python 3 kernels; however, if you have an existing notebook whose kernelspec is IR or Swift, that will work, since both R and Swift are installed in the container. Julia language can also work on Colab (with e.g. Python and GPUs; Google's tensor processing units also work with Julia on Colab[21]).[22][23]

Media coverage

  • On February 11, 2016, the LIGO collaboration announced the first observation of gravitational waves. The collaboration released the raw scientific data along with Jupyter Notebooks containing Python code to process the data and reproduce the figures from the discovery paper.[24]
  • On April 5, 2018, The Atlantic published an article entitled The Scientific Paper Is Obsolete, which discussed the role of the Jupyter Notebook and the Mathematica notebook in the future of scientific publishing.[12] This article led to responses from prominent scientists and academics, including economist Paul Romer.[25]

Grants and awards

gollark: The osmarks.net infrastructure is so reliable that I occasionally have to pull up mosh when out traveling and such in case of [REDACTED] λ-44 events.
gollark: Obviously ability to edit on mobile phones is a key concern, yes.
gollark: The code on disk should be an AST which your editor can manipulate and display as you wish.
gollark: Why even have indenting? The current paradigm of code-as-text is foolish and outdated.
gollark: The latest mgollark output:> .<|endoftext|>No.<|endoftext|>I think I have a script for that.<|endoftext|>I mean, you need the todo list and add it.<|endoftext|>I can't think of any.<|endoftext|>Hmm, the problem is that you can't really pull past messages.<|endoftext|>*is tempted to have not got it and my bot bot's now message thingy*<|endoftext|>Well, this bot is in the badserver's main channel...<|endoftext|>... and?<|endoftext|><@!111569489971159040><|endoftext|>Contents<|endoftext|>Or, if you have a dedicated channel, like?<|endoftext|>Contents<|endoftext|>Contents<|endoftext|>I mean, it's *mostly* separate from that, but kind of separate from discord.<|endoftext|>What?<|endoftext|>Contents<|endoftext|>Contents<|endoftext|>Contents<|endoftext|>

See also

References

  1. "Project Jupyter - About Us". 2018-04-20. Retrieved 2018-05-03.
  2. "Project Jupyter // Speaker Deck".
  3. "The Notebook, Qt console and a number of other pieces are now parts of Jupyter".
  4. "The Big Split™".
  5. "Project Jupyter | Home".
  6. sshirokov (2015-05-07). "GitHub + Jupyter Notebooks = <3". The GitHub Blog. Retrieved 2018-04-10.
  7. "Rendering Notebooks on GitHub – Jupyter Blog". Jupyter Blog. 2015-05-07. Retrieved 2018-04-10.
  8. "What's new in IPython > Issues closed in the 2.x development cycle".
  9. "What's new in IPython > 2.0 Series".
  10. "Jupyter kernels > List of (some) IPython compatible kernels".
  11. "Notebook's announcement- 0.12 release note".
  12. Somers, James. "The Scientific Paper Is Obsolete". The Atlantic. Retrieved 2018-04-10.
  13. https://jupyter.org/hub
  14. "Jupyo | Jupyter notebooks for Python, R, Julia in the cloud". jupyo.com. Archived from the original on 2019-01-03. Retrieved 2019-01-02.
  15. "JupyterLab is Ready for Users – Jupyter Blog". Jupyter Blog. 2018-02-20. Retrieved 2018-05-04.
  16. "Amazon SageMaker on AWS". Amazon Web Services, Inc. Retrieved 2018-05-09.
  17. "Welcome to Colaboratory". research.google.com. Retrieved 2018-05-09.
  18. "Microsoft Azure Notebooks - Online Jupyter Notebooks". notebooks.azure.com. Retrieved 2018-05-09.
  19. "Nerds rejoice: Google just released its internal tool to collaborate on AI". Quartz. Retrieved 2018-09-06.
  20. "Open in Colab GitHub repository". GitHub. Retrieved 2018-09-06.
  21. Julia on TPUs, JuliaTPU, 2019-12-03, retrieved 2019-12-03
  22. "Google Colaboratory". colab.research.google.com. Retrieved 2019-12-06.
  23. "gpu - Julia in Google Colab". Stack Overflow. Retrieved 2019-12-06.
  24. "LIGO Open Science Center". losc.ligo.org. Retrieved 2018-05-04.
  25. "Jupyter, Mathematica, and the Future of the Research Paper – Paul Romer". paulromer.net. Retrieved 2018-04-15.
  26. "Sloan Foundation Grant — IPython". ipython.org. Retrieved 2018-05-03.
  27. "An Open Source Framework for Interactive, Collaborative and Reproducible Scientific Computing and EducationOpen Source Tools for Interactive, Collaborative and Reproducible Computing". ipython.org. Retrieved 2018-05-03.
  28. Perez, Fernando (December 28, 2015). "IPython 2015 Final Report - Sloan Foundation" (PDF). ipython.org. Retrieved May 3, 2018.
  29. "UC Berkeley and Cal Poly to Expand and Enhance Open-Source Software for Scientific Computing and Data Science | Helmsley Charitable Trust". helmsleytrust.org. Retrieved 2018-05-03.
  30. "Software System Award". ACM Awards. Association for Computing Machinery. Retrieved April 28, 2016.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.