Caustic (optics)

In optics, a caustic or caustic network[1] is the envelope of light rays reflected or refracted by a curved surface or object, or the projection of that envelope of rays on another surface.[2] The caustic is a curve or surface to which each of the light rays is tangent, defining a boundary of an envelope of rays as a curve of concentrated light.[2] Therefore, in the photo on the side, caustics can be seen as patches of light or their bright edges. These shapes often have cusp singularities.

Nephroid caustic at bottom of tea cup

Caustics made by the surface of water

Caustics produced by a glass of water

Explanation

The rays refracted by a non-flat surface form caustics where many of them cross.

Concentration of light, especially sunlight, can burn. The word caustic, in fact, comes from the Greek καυστός, burnt, via the Latin causticus, burning. A common situation where caustics are visible is when light shines on a drinking glass. The glass casts a shadow, but also produces a curved region of bright light. In ideal circumstances (including perfectly parallel rays, as if from a point source at infinity), a nephroid-shaped patch of light can be produced.[3][4] Rippling caustics are commonly formed when light shines through waves on a body of water.

Another familiar caustic is the rainbow.[5][6] Scattering of light by raindrops causes different wavelengths of light to be refracted into arcs of differing radius, producing the bow.

Computer graphics

Photograph of a typical wine glass caustic

Computer rendering of a wine glass caustic

In computer graphics, most modern rendering systems support caustics. Some of them even support volumetric caustics. This is accomplished by raytracing the possible paths of a light beam, accounting for the refraction and reflection. Photon mapping is one implementation of this. Volumetric caustics can also be achieved by volumetric path tracing. Some computer graphic systems work by "forward ray tracing" wherein photons are modeled as coming from a light source and bouncing around the environment according to rules. Caustics are formed in the regions where sufficient photons strike a surface causing it to be brighter than the average area in the scene. “Backward ray tracing” works in the reverse manner beginning at the surface and determining if there is a direct path to the light source.[7] Some examples of 3D ray-traced caustics can be found here.

The focus of most computer graphics systems is aesthetics rather than physical accuracy. This is especially true when it comes to real-time graphics in computer games[8] where generic pre-calculated textures are mostly used instead of physically correct calculations.

Caustic engineering

Caustic engineering describes the process of solving the inverse problem to computer graphics. That is, given a specific image, to determine a surface whose refracted or reflected light forms this image.

In the discrete version of this problem, the surface is divided into several micro-surfaces which are assumed smooth, i.e. the light reflected/refracted by each micro-surface forms a Gaussian caustic. Gaussian caustic means that each micro-surface obey gaussian distribution. The position and orientation of each of the micro-surfaces is then obtained using a combination of Poisson integration and simulated annealing.[9]

There have been many different approaches to address the continuous problem. One approach uses an idea from transportation theory called optimal transport[10] to find a mapping between incoming light rays and the target surface. After obtaining such a mapping, the surface is optimized by adapting it iteratively using Snell's law of refraction.[11][12]

Optimal-transport-based caustic pattern design

Basic principle

Controlling caustic pattern is rather a challenging problem as very minor changes of the surface will significantly affect the quality of the pattern since light ray directions might be interfered by other light rays as they intersect with and refract through the material. This will lead to a scattered, discontinuous pattern. To tackle this problem, optimal-transport-based is one of the existing proposed methods to control caustic pattern by redirecting light's directions as it propagates through the surface of a certain transparent material. This is done by solving an inverse optimization problem based on optimal transport.[13][14] Given a reference image of an object/pattern, the target is to formulate the mathematical description of the material surface through which light refracts and converges to the similar pattern of the reference image. This is done by rearranging/recomputing the initial light intensity until the minimum of the optimization problem is reached.

Design pipeline

Here considering only refractive caustic, the objective can be determined as follows (similar principle for reflective caustic with different output):

Input: image of pattern to be obtained after propagating lights through the material, given the light source position.

Output: caustic geometry on the receiver (flat solid surface, e.g.: floor, wall, etc...)

In order to achieve the target pattern, the surface where light refracts through and exits to the outer environment must be manufactured into certain shape to achieve desired pattern on the other side of the material.

As mentioned, given an input image, this process will produce the similar caustic pattern as the output. In principle, there are two core stages with each includes two sub-stages:

• 

  Optimal-transport-based caustic design
  Solving Optimal Transport Problem
  1. Compute Target Light Distribution
  2. Compute Mapping from Initial Distribution to Target Distribution
• Optimizing Target Surface
  1. Compute Normal Representation of Surface
  2. Surface Refinement

Solving optimal transport problem

As the case refraction occurs through a transparent surface, for instance the patterns appearing under clear water surface, 3 main phenomena can be observed:

• Very bright (condensed light intensity) points (so-called singularity)
• Curve-like objects that connect the points
• Regions with low light intensity

To perform computation, the following 3 quantities are being respectively introduced to describe the geometric characteristics of the pattern: point singularity ${\displaystyle \Phi _{p}}$ (measuring light intensity at certain highly concentrated light-point), curve singularity ${\displaystyle \Phi _{c}}$ (measuring light intensity at/around a light-curve), and irradiance measure ${\displaystyle \Phi _{I}}$ (measuring intensity in a certain poorly concentrated light-area). Putting them altogether, the following function defines the total radiant flux measure ${\displaystyle \Phi _{T}}$ at a certain section Ω on the target surface:

${\displaystyle \Phi _{T}(\Omega )=\textstyle \sum _{i=1}^{N_{\delta }}\Phi _{p}^{i}(\Omega )+\sum _{j=1}^{N_{\gamma }}\Phi _{c}^{j}(\Omega )+\Phi _{I}(\Omega )\displaystyle }$

After this step, there are two existing measures of the radiant flux measures of the source ${\displaystyle \Phi _{S}}$ (uniform distribution, by initialization) and the target ${\displaystyle \Phi _{T}}$ (computed in previous step). What remains to compute is the mapping from the source to target. In order to do this, there are several quantities to be defined. Firstly, two light intensities evaluated by probabilities: ${\displaystyle \mu _{S}}$ (light intensity evaluated by dividing ${\displaystyle \Phi _{S}}$ by the flux of the union region between ${\displaystyle \Phi _{S}}$ and ${\displaystyle \Phi _{T}}$), ${\displaystyle \mu _{T}}$ (light intensity evaluated by dividing ${\displaystyle \Phi _{T}}$ by the flux of the union region between ${\displaystyle \Phi _{S}}$ and ${\displaystyle \Phi _{T}}$) are defined. Secondly, the source mesh is generated as multiple sites ${\displaystyle s_{i}\in (\Phi _{S}\cup \Phi _{T})}$, which is later being deformed. Next, a power diagram ${\displaystyle P_{w}}$ (a set of ${\displaystyle C_{i}^{w}}$ power cells) is defined on this set of sites ${\displaystyle s_{i}}$ weighted by a weight vector ${\displaystyle \omega }$. Finally, the goal is to decide whether which power cells are going to be move. Considering all ${\displaystyle x}$ vertices on the surface, finding the minimizer ${\displaystyle \omega _{min}}$ of the following convex function will produce the matched power diagram for the target:

${\displaystyle f(\omega )=\sum _{s_{i}\in S}(\omega _{i}.\mu _{S}(C_{i}^{0})-\int \limits _{C_{i}^{\omega }}(\|x-s_{i}\|^{2}-\omega _{i})d\mu _{T}(x))}$

Optimizing target surface

Computation Process

After solving optimal transport problem, the vertices are achieved. However, this gives no information about what the final surface should look like. To achieve the desired target surface given the incoming light ray ${\displaystyle d_{I}}$, outgoing light ray ${\displaystyle d_{O}}$ and power diagram from the step above, the surface normals representation can be computed according to Snell's law as:

${\displaystyle n=d_{I}+{\eta x \over \lVert d_{I}+\eta d_{T}\rVert }=d_{I}+{\eta x \over \lVert d_{I}+\eta {(x_{R}-x) \over ||x_{R}-x||}\rVert }}$

where,

${\displaystyle \eta }$: refraction coefficient

${\displaystyle x_{R}}$: target position obtained from solving above optimal transport problem

As the normal representation is obtained, surface refinement is then achieved by minimizing the following compound energy function:

${\displaystyle {\underset {x}{\operatorname {arg\,max} }}\,\omega \,\cdot [E_{int},\,E_{dir},\,E_{flux},\,E_{reg},\,E_{bar}]}$

where,

${\displaystyle E_{int}=\sum _{v\in M_{T}}\lVert n_{o}-n\rVert _{2}^{2}}$ is the integration energy that aligns the vertex normals ${\displaystyle n_{o}}$ obtained from the Optimal Transport with the target normals ${\displaystyle n}$ obtained from the Snell's law computation above.

${\displaystyle E_{dir}=\sum _{v\in M_{T}}\lVert x-{\textbf {proj}}_{(x_{S},\,d_{I})}(x)\rVert _{2}^{2}}$ as mesh generated in step Solving Optimal Transport cannot adapt to the sharp instances from the discontinuities, this energy is to penalize the vertices to not change significantly from the incoming light ray.

${\displaystyle E_{flux}=\sum _{t\in M_{T}}\lVert \Phi _{T}(t)-\Phi _{S}(t_{s})\rVert _{2}^{2}}$ is the energy measuring the flux over the triangle ${\displaystyle t}$ in the mesh.

${\displaystyle E_{reg}=\lVert {\textbf {L}}{\textbf {X}}\rVert _{2}^{2}}$ is the energy that regularizes the shape of the triangles to maintain its well-shapedness.

${\displaystyle E_{bar}=\sum _{v\in M_{T}}\lVert max(0,-log((1-n_{R}.(x-x_{R}))+d_{TH})\rVert ^{2}}$ is barrier energy to ensure that surface does not deform beyond a certain distance threshold ${\displaystyle d_{TH}}$.

Differentiable inverse rendering caustic pattern design

Basic principle

Inverse graphics is a method to observe the data from image and infer all possible properties including 3D geometry, lighting, materials, and motion, thus generating realistic image.[15] In conventional computer graphics, to render an image with desired appearance and effects, it is given all the properties/characteristics. This could be considered as the forward process. On the contrary, in caustic design, the properties and characteristics of objects (especially the material surface) are not trivial. The given constraint is the target image to obtain . Therefore, the goal is to get the properties and characteristics by observing and inferring the target image. This can be considered the inverse/backward process.

The following is the basic loss function explaining how to optimize the parameters:

${\displaystyle L(c)=\lVert f(c)-I\rVert ^{2}}$

where,

L(c): loss function, mean square error of the rendered image and the target

c: contains elements which can influence the generated image

I: target image

Designed pipeline

Differentiable inverse rendering caustic design

At first, the target pattern is designed and compute the forward pass to get the synthetic pattern. It's compared to the target pattern and get the loss. The objection is to let the synthetic pattern is similar to the target pattern as much as possible. And then do the back propagation to get the optimized properties need to use in caustic manufacturing.

Elements contributing to generated image

• Appearance (${\displaystyle A}$): per-pixel surface appearance is modeled as product of mipmapped texture and per-pixel brightness.
• Geometry (${\displaystyle V}$): assume a 3D scene to be approximated by triangles, parameterized by vertices ${\displaystyle V}$.
• Camera (${\displaystyle C}$): focal length, the point of view, the center of the camera.

There could be more elements, for example albedo and refraction coefficient.

General differentiable framework

Introduce U as an intermediate variable indicating 2D projected vertex coordinate positions. The gradient of these properties can be derived by chain rule indirectly.

${\displaystyle {\frac {\partial f}{\partial V}}={\frac {\partial f}{\partial U}}\times {\frac {\partial U}{\partial V}}}$

${\displaystyle {\frac {\partial f}{\partial V}}={\frac {\partial f}{\partial A}}\times {\frac {\partial A}{\partial V}}}$

${\displaystyle {\frac {\partial f}{\partial C}}={\frac {\partial f}{\partial U}}\times {\frac {\partial U}{\partial C}}}$

After applying the stochastic gradient descent, the optimal ${\displaystyle A}$, ${\displaystyle V}$ and ${\displaystyle C}$ could be achieved. Subsequently, these quantities are used to carve or mill the material to generate the target pattern.

Implementation

One common approach is to utilize the ability to perform differential operations in various deep learning auto-differentiation frameworks/libraries such as: Tensorflow, PyTorch, Theano.

One more approach is to make use of the OpenDR[16] framework to build a forward graphics model and to automatically obtain derivatives with respect to the model parameters for optimization. As optimization properties are obtained, the target image can be generated. OpenDR provides a local optimization method that can be incorporated into probabilistic programming frameworks. This can be used to solve the problem of caustic.

Manufacturing

Design and manufacturing process

Once the caustic pattern has been designed computationally, the processed data will be then sent to the manufacturing stage to get the final product. The most common approach is subtractive manufacturing (machining).

Various materials can be used depending on the desired quality, the effort it takes to manufacture, and the available manufacturing method.

• Common refractive materials: Acrylic, Polycarbonate, Polyethylene, Glass, Diamond
• Common reflective materials: Steel, Iron, Aluminum, Gold, Silver, Titanium, Nickel

Architecture

Caustic pattern design has many real-world applications, for example in:

• Luminaires
• Jewelry
• Architecture
• Decorative glass production

See also

• Focus (optics)
• Circle of confusion
• Caustic (mathematics)
• Voronoi diagram
• Imperative programming
• Parallel programming model

References

1. Lynch, DK; Livingston, W (2001). "The caustic network". Color and Light in Nature. Cambridge University Press. ISBN 978-0-521-77504-5.
2. Weinstein, Lev Albertovich (1969). Open Resonators and Open Waveguides. Boulder, Colorado: The Golem Press.
3. Circle Catacaustic. Wolfram MathWorld. Retrieved 2009-07-17.
4. Levi, Mark (2018-04-02). "Focusing on Nephroids". SIAM News. Retrieved 2018-06-01.
5. Rainbow caustics
6. Caustic fringes
7. Guardado, Juan (2004). "Chapter 2. Rendering Water Caustics". In Fernando, Randima (ed.). GPU Gems: Programming Techniques, Tips and Tricks for Real-Time Graphics. Addison-Wesley. ISBN 978-0321228321.
8. "Caustics water texturing using Unity 3D". Dual Heights Software. Retrieved May 28, 2017.
9. Marios Papas (April 2011). "Goal Based Caustics". Computer Graphics Forum (Proc. Eurographics). 30 (2).
10. Villani, Cedric (2009). Optimal Transport - Old and New. Springer-Verlag Berlin Heidelberg. ISBN 978-3-540-71049-3.
11. Philip Ball (February 2013). "Light tamers". New Scientist. 217 (2902): 40–43. Bibcode:2013NewSc.217...40B. doi:10.1016/S0262-4079(13)60310-3.
12. Choreographing light: New algorithm controls light patterns called 'caustics', organizes them into coherent images
13. Yuliy Schwartzburg, Romain Testuz, Andrea Tagliasacchi, Mark Pauly (2014). "High-contrast Computational Caustic Design" (PDF).CS1 maint: multiple names: authors list (link)
14. Cédric, Villani (2009). Optimal Transport, Old and New. Springer. ISBN 978-3-540-71050-9.
15. Loper, Matthew M.; Black, Michael J. (2014), "OpenDR: An Approximate Differentiable Renderer", Computer Vision – ECCV 2014, Springer International Publishing, pp. 154–169, doi:10.1007/978-3-319-10584-0_11, ISBN 978-3-319-10583-3
16. Loper, Matthew M.; Black, Michael J. (2014), "OpenDR: An Approximate Differentiable Renderer", Computer Vision – ECCV 2014, Springer International Publishing, pp. 154–169, doi:10.1007/978-3-319-10584-0_11, ISBN 978-3-319-10583-3

• Born, Max; Wolf, Emil (1999). Principles of Optics: Electromagnetic Theory of Propagation, Interference and Diffraction of Light (7th ed.). Cambridge University Press. ISBN 978-0-521-64222-4.
• Nye, John (1999). Natural Focusing and Fine Structure of Light: Caustics and Wave Dislocations. CRC Press. ISBN 978-0-7503-0610-2.

Further reading

• Ferraro, Pietro (1996). "What a caustic!". The Physics Teacher. 34 (9): 572–573. Bibcode:1996PhTea..34..572F. doi:10.1119/1.2344572.
• Dachsbacher, Carsten; Liktor, Gábor (February 2011). "Real-time volume caustics with adaptive beam tracing". Symposium on Interactive 3D Graphics and Games. ACM: 47–54.