diff --git a/CC.tex b/CC.tex index 41aa99a..c971789 100644 --- a/CC.tex +++ b/CC.tex @@ -22,7 +22,7 @@ \subsubsection{The problem} \subsubsection{Adaptation} -`Adaptation' is the general mechanism by which a finite range of sensitivity can be shifted within absolute sensitivity bounds. The benefit of having an adaptive system, as opposed to a fixed system, is that the sensitivity of the system to small changes is maximised, whilst maintaining a broad overall sensitivity, at the expense of being able to sense over the entire range at a single time-point. A visual demonstration of this is shown in Figure \ref{fig:Valeton} where it can be seen that that at a single level of adaptation (a single line) the range of intensity over which responses are generated is relatively small, but is extended through adaptation. +`Adaptation' is the general mechanism by which a finite range of sensitivity can be shifted within absolute sensitivity bounds. The benefit of having an adaptive system, as opposed to a fixed system, is that the sensitivity of the system to small changes is maximised, whilst maintaining a broad overall sensitivity, at the expense of being able to sense over the entire range at a single time-point. A visual demonstration of this is shown in Figure \ref{fig:Valeton} where it can be seen that at a single level of adaptation (a single line) the range of intensity over which responses are generated is relatively small, but is extended through adaptation. \begin{figure}[htbp] \includegraphics[max width=\textwidth]{figs/LitRev/Valeton.png} diff --git a/Colorimetry.tex b/Colorimetry.tex index 9b6b129..4ea4687 100644 --- a/Colorimetry.tex +++ b/Colorimetry.tex @@ -205,7 +205,7 @@ \subsubsection{Correlated Colour Temperature} where $\operatorname{sgn}(z)=1$ for $z\geq0$ and $\operatorname{sgn}(z)=-1$ for $z<0$. -\citet{ohno_practical_2014} notes that the combination of \gls{CCT} and $D_{\text {uv }}$ is suffice to describe the chromaticity of most light sources, and does so in a fashion which is slightly more intuitive than values of chromaticity. +\citet{ohno_practical_2014} notes that the combination of \gls{CCT} and $D_{\text {uv }}$ is sufficient to describe the chromaticity of most light sources, and does so in a fashion which is slightly more intuitive than values of chromaticity. \begin{figure}[htbp] \includegraphics[max width=\textwidth]{figs/LitRev/BBR.pdf} diff --git a/Interviews.tex b/Interviews.tex index e751452..79498b7 100644 --- a/Interviews.tex +++ b/Interviews.tex @@ -85,6 +85,6 @@ \section{Conclusion} \section{Interim Summary} -The impact that these interviews had on the research which followed is such; it became clear that \gls{CCT} was a tool which could be used to reduce damage, but which was not being used at the time. One of the barriers to use was a lack of understanding of how \gls{CCT} interacted with other visual appearance properties and preference. It therefore seemed valuable to attempt to extend our understanding of chromatic adaptation and colour constancy, with the hope that this would allow museum professionals to limit damage through specification of lower values of \gls{CCT}. +The impact that these interviews had on the research which followed is thus; it became clear that \gls{CCT} was a tool which could be used to reduce damage, but which was not being used at the time. One of the barriers to use was a lack of understanding of how \gls{CCT} interacted with other visual appearance properties and preference. It therefore seemed valuable to attempt to extend our understanding of chromatic adaptation and colour constancy, with the hope that this would allow museum professionals to limit damage through specification of lower values of \gls{CCT}. The following chapters all seek to extend our knowledge of colour constancy and chromatic adaptation. \ No newline at end of file diff --git a/LargeSphere.tex b/LargeSphere.tex index a69feb8..caaa155 100644 --- a/LargeSphere.tex +++ b/LargeSphere.tex @@ -7,7 +7,7 @@ \chapter{Large Sphere Experiment} %new name? \section{Summary} -The goal of this experimental work was to examine the effect of different wavelengths of light upon chromatic adaptation. Our hypothesis was that \gls{ipRGC} stimulation may need to be considered in order to fully model the induced adaptation, with the null hypothesis being that chromatic adaptation can be fully accounted for by cone and rod mechanisms. If evidence of a melanopic input to chromatic adaptation were found, it may help to explain conflicting results in previous experiments which sought a `preferred \gls{CCT}', which may in turn allow for control of \gls{CCT} in museums to be used more extensively as a means to control damage to objects. +The goal of this experimental work was to examine the effect of different wavelengths of light upon chromatic adaptation. Our hypothesis was that \gls{ipRGC} stimulation may need to be considered in order to fully model the induced adaptation, with the null hypothesis being that chromatic adaptation can be fully accounted for by cone and rod mechanisms. If evidence of a melanopic input to chromatic adaptation was found, it may help to explain conflicting results in previous experiments which sought a `preferred \gls{CCT}', which may in turn allow for control of \gls{CCT} in museums to be used more extensively as a means to control damage to objects. This experiment is of a similar type to those discussed in Section \ref{sec:aadi}. Within a Ganzfeld viewing environment, illuminated by one of 16 different wavelengths of near-monochromatic light, observers performed an achromatic setting task, controlling the chromaticity of a display visible in the central field through a 4$^{\circ}$ circular aperture with two handheld sliders. Under these conditions it would be expected that an observer's chosen achromatic point would correspond in hue to the adapting field, and be of a saturation somewhere between a nominal objective white point and the adapting stimulus. If melanopsin were involved in chromatic adaptation we may expect unusual results for the part of the spectrum that melanopsin is most sensitive to (roughly 480nm). @@ -45,7 +45,7 @@ \subsection{Observer task} On average it took observers roughly 20 seconds to make a selection. Once the observer was happy with the achromacy of the patch, a button was pressed to record the setting and a new random colour would be presented. The first displayed colour was at \gls{CIE} L* (of CIELAB and CIELUV) of 85, with subsequent colours descending by 5 L* until 10 L*. -This sequence was repeated 10 times per session. Per session observers made 10 selections at 16 lightness levels (160 total). Observers performed 16 sessions (2560 selections total), one session for each surround adapting wavelength. The overall protocol is visualised in Figure \ref{fig:ExperimentalPro}. Observers found sessions quite fatiguing and generally did not wish to do more than two or three sessions per day. A brief break was generally taken between sessions, though minimum time for such was prescribed. +This sequence was repeated 10 times per session. Per session observers made 10 selections at 16 lightness levels (160 total). Observers performed 16 sessions (2560 selections total), one session for each surround adapting wavelength. The overall protocol is visualised in Figure \ref{fig:ExperimentalPro}. Observers found sessions quite fatiguing and generally did not wish to do more than two or three sessions per day. A brief break was generally taken between sessions, though no minimum time for such was prescribed. For one observer, in an additional (17th) session the narrow-band filter was replaced by a neutral density filter, to produce an achromatic adapting field. @@ -166,7 +166,7 @@ \subsection{Chromaticity-based analysis} \begin{figure}[htbp] \includegraphics[max width=\textwidth]{figs/LargeSphere/TRcompareWithSurround.pdf} -\caption{As per Figure \ref{fig:LMCompSurr} but for the data of TR. Note that the white point used for visualisation relate to the white points used during data collection, which differ for each observer.} +\caption{As per Figure \ref{fig:LMCompSurr} but for the data of TR. Note that the white points used for visualisation are the white points used during data collection, which differ for each observer.} \label{fig:TRCompSurr} \end{figure} @@ -187,7 +187,7 @@ \subsubsection{Colour Constancy Indices} where $b$ is the distance between the post-adaptation point and the ideal match, and $a$ is the distance between the pre-adaptation point and the ideal match\footnote{For further discussion see \citet[Section 4.1, pg. 681]{foster_color_2011}.}. -There are multiple reasonable options for which value to use as a `pre-adaptation point'. First, the origin of the space within which selections are made (different for each observer) seems to be a possible option; this corresponds to the central point on each slider over time for each individual. However, though the set-up ascribes some value to this point, it is not definitively linked to the settings that observers made; it can be seen in Figures \ref{fig:LMCompSurr} and \ref{fig:TRCompSurr} that there seems to be no particular relevance of the point [0,0]. A second option would be to use the measurements made under a neutral density filter for both observers. This data has not been used thus far. However, again there is no actual significance of these values - a neutral density filter could be slightly chromatic and still be labelled as a neutral density filter, and even if it were perfectly spectrally neutral, it's designation as a gold standard `neutral' only actually passes on responsibility to the chromaticity of the projector lamp, which is under no obligation to be especially `neutral'. The third option is to use the average setting value, which has no specific logical background, but is vastly more practically relevent than the previous two options. This third option was chosen for future analyses. +There are multiple reasonable options for which value to use as a `pre-adaptation point'. First, the origin of the space within which selections are made (different for each observer) seems to be a possible option; this corresponds to the central point on each slider over time for each individual. However, though the set-up ascribes some value to this point, it is not definitively linked to the settings that observers made; it can be seen in Figures \ref{fig:LMCompSurr} and \ref{fig:TRCompSurr} that there seems to be no particular relevance of the point [0,0]. A second option would be to use the measurements made under a neutral density filter. However, again there is no actual significance of these values - a neutral density filter could be slightly chromatic and still be labelled as a neutral density filter, and even if it were perfectly spectrally neutral, its designation as a gold standard `neutral' only actually passes on responsibility to the chromaticity of the projector lamp, which is under no obligation to be especially `neutral'. The third option is to use the average setting value, which has no specific logical background, but is vastly more practically relevent than the previous two options. This third option was chosen for future analyses. Averaging over time for each observer, and using the average response for each observer as the pre-adaptation point yields \glspl{CCI} as shown in Figures \ref{fig:LMCCI} and \ref{fig:TRCCI}. Only data for L* of 20 and 60 is plotted for clarity, in keeping with previous figures. It can be seen that there are common trends across wavelength at the different values of L*. @@ -205,13 +205,13 @@ \subsubsection{Colour Constancy Indices} It is highly unusual for values of \gls{CCI} to be below 0; this indicates that the selected post-adaptation point is further from the pre-adaptation point than the ideal match. Normally, assuming that adaptation occurred on the same vector as that connecting the neutral point and the ideal match, this would mean that the observer had \emph{over}-adapted, something which is very unusual. Additionally, results like this generally aren't seen because observers are adapted to highly saturated adapters, often on/near the spectral locus, and colours outside of this simply don't exist to be chosen (in a linear space). -We see such results here for a number of reasons. Firstly, we are not in a linear space. In CIELAB the chromatic gamut increases as a function of L*, meaning that a high L* value can be outside of the gamut of a set of low L* primaries. Secondly, in concert with this non-linearity, the slider ranges were fixed to represent a broader range of a* and b* values are higher L* values (otherwise it would have felt as though a specific movement at low L* would have resulted in a much greater chromatic shift than that same movement would have done for higher values of L*). The effect of this is visualised in Figure \ref{fig:overviewBL}. +We see such results here for a number of reasons. Firstly, we are not in a linear space. In CIELAB the chromatic gamut increases as a function of L*, meaning that a high L* value can be outside of the gamut of a set of low L* primaries. Secondly, in concert with this non-linearity, the slider ranges were fixed to represent a broader range of a* and b* values at higher L* values (otherwise it would have felt as though a specific movement at a low value of L* would have resulted in a much greater chromatic shift than that same movement would have done for higher values of L*). The effect of this is visualised in Figure \ref{fig:overviewBL}. Additionally, it appears as though there is substantial offsetting and L* dependent shifting, which call into question the appropriateness of such a metric. It should also be noted that in this current analysis, averages are taken over time, which obscures and adopts any underlying trends which time may influence. It seems as though there is a risk of obscuring more than is revealed through use of such a metric. However, it is curious to see a dip in the results for both observers at 500nm, which is roughly where we might expect to see an effect should there be an effect of melanopsin (which theoretically peaks at around 480nm, but is predicted to have an increased value of peak sensitivity as a function of pre-receptoral filtering). Based on Figures \ref{fig:LMCompSurr} and \ref{fig:TRCompSurr} this was not anticipated. However, without a clear prediction for what effect we would expect melanopsin to have (in terms of the direction or magnitude of effect) I suggest caution in interpreting this as evidence of an effect. This peak could also be the result of rod-based intrusions (the peak of the rod \gls{SSF} is 507nm). It is unclear what magnitude and vector of effect should be expected from rod intrusion. -Averaging over wavelength and time allows us to visualise the effect of L*. Here, instead of calculating the \gls{CCI}, a simpler measure is used: the distance from the pre-adaptation point (the average of all recorded achromatic points, per observer) to the post-adaptation point. This gives us a rawer impression of the extent of adaptation, without the assumption of adaptation vector angle. In the context of Equation \ref{eq:CCI} this value could be denoted $c$, as it represents the final side of the triangle $abc$. +Averaging over wavelength and time allows us to visualise the effect of L*. Here, instead of calculating the \gls{CCI}, a simpler measure is used: the distance from the pre-adaptation point (the average of all recorded achromatic points, per observer) to the post-adaptation point. This gives us a more direct impression of the extent of adaptation, without the assumption of adaptation vector angle. In the context of Equation \ref{eq:CCI} this value could be denoted $c$, as it represents the final side of the triangle $abc$. It is assumed, based on the analysis presented in Figure \ref{fig:overviewBL}, that as L* increases, the length of these vectors shall increase, simply as a result of the experimental set-up. This is shown to be the case in Figures \ref{fig:LMCCI_L} and \ref{fig:TRCCI_L}, with near monotonic increases as L* increases for both observers. @@ -241,7 +241,7 @@ \subsubsection{Colour Constancy Indices} \label{fig:TRCCI_T} \end{figure} -A three-way ANOVA performed upon the data, treating wavelength, time and L* and independent categorical variables found a significant effect of each, as shown in Figures \ref{fig:anova} and \ref{fig:anova2}, with a level of $\alpha$ of 0.05. +A three-way ANOVA performed upon the data, treating wavelength, time and L* as independent categorical variables found a significant effect of each, as shown in Figures \ref{fig:anova} and \ref{fig:anova2}, with a level of $\alpha$ of 0.05. \begin{figure}[htbp] \includegraphics[max width=\textwidth]{figs/LargeSphere/anova.png} @@ -255,7 +255,7 @@ \subsubsection{Colour Constancy Indices} \label{fig:anova2} \end{figure} -Whilst variables were treated as categorical in the above analysis, there would be an argument for treating each as a continuous variable. However, several factors would need to be considered. Foremost, whilst wavelength is nominally a continuous variable, in this experiment each wavelength category had a difference level of radiance, which means that caution should be taken in assuming their equivalence. It is also possible that each filter might have a meaningfully different spectral transmission profile, specifically the band-pass width (see Figure \ref{fig:LSillum}). +Whilst variables were treated as categorical in the above analysis, there would be an argument for treating each as a continuous variable. However, several factors would need to be considered. Foremost, whilst wavelength is nominally a continuous variable, in this experiment each wavelength category had a different level of radiance, which means that caution should be taken in assuming their equivalence. It is also possible that each filter might have a meaningfully different spectral transmission profile, specifically the band-pass width (see Figure \ref{fig:LSillum}). Caution is also required regarding the assumption of independence of measurements. Due to the nature of chromatic adaptation, it would not be possible to interleave conditions, and so wavelength is further confounded with various other factors; date, time of day, and all manner of secondary factors relating to these (whether the observer has eaten recently for example). @@ -441,9 +441,9 @@ \subsection{Further Work} \section{Interim Summary} -The experiment reported in this chapter aimed to extend our understanding of colour constancy and chromatic adaptation, specifically asking whether there was a melanopic influence. No clear effect for a melanopic influence was found, though the absence of an effect could not be authoritatively be confirmed. +The experiment reported in this chapter aimed to extend our understanding of colour constancy and chromatic adaptation, specifically asking whether there was a melanopic influence. No clear effect for a melanopic influence was found, though the absence of an effect could not be authoritatively confirmed. -A large number of limitations were identified with this experimental set-up, and it was deemed appropriate to develop a second version of this experimental set-up, and perform a further experiment. This further experiment is reported in the following chapter. +A large number of limitations were identified, and it was deemed appropriate to develop a second version of this experimental set-up, and perform a further experiment. This further experiment is reported in the following chapter. diff --git a/LitReview.tex b/LitReview.tex index 6f9ec12..af9d280 100644 --- a/LitReview.tex +++ b/LitReview.tex @@ -31,7 +31,7 @@ \section{Colour Science} \section{Interim Summary} -This chapter has laid out the state of the art in the research areas which the other chapters of this thesis build upon. +This chapter has laid out the most relevant developments in the research areas which the other chapters of this thesis build upon. Chapter \ref{chap:Interviews} builds upon our museum lighting knowledge by filling the gap in our understanding of how museum lighting is actually thought about and selected currently, and tries to identify the most fruitful avenue for future research which will allow the reduction of damage to objects in museums. diff --git a/MethodsForCC.tex b/MethodsForCC.tex index 6dff3c0..5636f35 100644 --- a/MethodsForCC.tex +++ b/MethodsForCC.tex @@ -54,11 +54,11 @@ \subsubsection{Within Vision Science} \label{sec:methvis} \paragraph{Discriminating illumination changes from reflectance changes} provides a key way to examine colour constancy in an operational manner. Following the assumption that chromatic adaptation allows an observer to discount the illumination in some manner, an experimental set up where observers are requested to distinguish between an illumination change and a reflectance change represents a situation which very closely mirrors the natural process of colour constancy. This experimental technique is well placed to examine whether or not colour constancy in this form is active and efficient, but it provides little way of probing the underlying mechanisms of colour constancy. -\paragraph{Illumination discrimination tasks} comprise a scene which is unvarying in terms of content and surface reflectances, but varying in terms of illumination. In the general set-up (such as that described by \citet{pearce_chromatic_2014}), a target illumination is compared to two test illuminations, where one of the test illuminations is identical to the the target illumination and the other differs in chromaticity. The observer performs a two-alternative forced choice task whereby they attempt to identify the identical illumination, and from this estimates of the observers discrimination thresholds for illuminations of differing chromatic directions away from the test illumination can be estimated. \citet{aston_illumination_2019} describes the interpretation of data from such as experiments as offering two types of insight. Firstly, where no difference can be seen by observers this can be thought of as perfect colour constancy (assuming that the chromaticity differences are above surface discriminability thresholds) and comparisons across different chromatic directions can be made. Secondly, an indication as to the accuracy with which illumination colour is encoded can be gleaned. Concerns regarding this methodology were recently raised by \citet{weiss_determinants_2017} who ``did not find any relationship between achromatic adjustments and illumination discrimination thresholds'' which ``casts doubt on the idea that illumination discrimination directly translates into colour constancy''. +\paragraph{Illumination discrimination tasks} comprise a scene which is unvarying in terms of content and surface reflectances, but varying in terms of illumination. In the general set-up (such as that described by \citet{pearce_chromatic_2014}), a target illumination is compared to two test illuminations, where one of the test illuminations is identical to the target illumination and the other differs in chromaticity. The observer performs a two-alternative forced choice task whereby they attempt to identify the identical illumination, and from this estimates of the observers discrimination thresholds for illuminations of differing chromatic directions away from the test illumination can be estimated. \citet{aston_illumination_2019} describes the interpretation of data from such experiments as offering two types of insight. Firstly, where no difference can be seen by observers this can be thought of as perfect colour constancy (assuming that the chromaticity differences are above surface discriminability thresholds) and comparisons across different chromatic directions can be made. Secondly, an indication as to the accuracy with which illumination colour is encoded can be gleaned. Concerns regarding this methodology were recently raised by \citet{weiss_determinants_2017} who ``did not find any relationship between achromatic adjustments and illumination discrimination thresholds'' which ``casts doubt on the idea that illumination discrimination directly translates into colour constancy''. \subsubsection{Achromatic Adjustments under Different Illuminations} \label{sec:aadi} -A number of researchers have performed experiments similar in nature to those reported in Chapters \ref{chap:LargeSphere} and \ref{chap:LargeSphere}, and these are summarised below. These references were added following suggestions by the examining committee for this thesis. +A number of researchers have performed experiments similar in nature to those reported in Chapters \ref{chap:LargeSphere} and \ref{chap:SmallSphere}, and these are summarised below. These references were added following suggestions by the examining committee for this thesis. \textbf{\citet{werner_effect_1982}}\footnote{More succinctly reported in \citet{walraven_chromatic_1982}.} performed an achromatic adjustment experiment whereby chromatic annuli (60'-90') were presented as flashed stimuli (3 seconds on, 3 seconds off) on top of a background pedestal of varying chromaticity, and the observer's task was to modify the chromaticity of the annuli such that they appeared achromatic. diff --git a/MuseumLighting.tex b/MuseumLighting.tex index 49483e6..00dc164 100644 --- a/MuseumLighting.tex +++ b/MuseumLighting.tex @@ -111,7 +111,7 @@ \subsection{Visitor Requirements of Museum Lighting} Traditionally, the principal manner in which museum professionals sought to limit damage was through setting a maximum luminance level. The implicit assumptions in this process are twofold; firstly: that damage will increase with increased luminance. This was a fairer assumption when tungsten was the only type of lighting technology, but as other lighting technologies with different \glspl{SPD} have been introduced this assumption has become less accurate (see Section \ref{sec:DamageIndex}: \nameref{sec:DamageIndex}). The second implicit assumption is that viewers will prefer higher luminance environments. -The classic study on this second assumption, performed in a mock-museum environment is that of \citet{loe_preferred_1982}. This research regards the display of oil and watercolour paintings specifically. In this study Loe et al. examined three variables: painting illuminance, light source (different technologies) and light distribution. Following the construction of a mock up gallery space, observers were asked to view paintings of various types under a range of illuminations, varying in `painting illuminance, light source and light distribution within the gallery space' and report upon semantic scales their perceptions. The results which informed the 200 lux recommendation stem from only the first variable, painting illuminance. Here it was found (as shown in Figure \ref{fig:Loe}) that for factors christened `discrimination' and `quality evaluation' (distilled from factor analysis of the original semantic data) there was `a steep rise in discrimination and quality assessment until and illuminance of approximately 200 lux is reached: above this illuminance the rate of increase in reduced.' This conclusion has had substantial impact in setting guidelines and future thinking was that a minimum of 200 lux was required to `give visual satisfaction', however it can be seen from Figure \ref{fig:Loe} that the data is sparse, noisy, dependent upon brand of lighth source and doesn't show a particularly strong effect of 200 lux in particular. Further, only a small number of different luminances were sampled, and it is quite possible that the results are at the mercy of several types of bias \citep{fotios_research_2009}. The value of 200 lux was subsequently used in \citet{thomson_museum_1978}, which has informed a great deal of subsequent thinking on the topic. +The classic study on this second assumption, performed in a mock-museum environment is that of \citet{loe_preferred_1982}. This research regards the display of oil and watercolour paintings specifically. In this study Loe et al. examined three variables: painting illuminance, light source (different technologies) and light distribution. Following the construction of a mock up gallery space, observers were asked to view paintings of various types under a range of illuminations, varying in `painting illuminance, light source and light distribution within the gallery space' and report upon semantic scales their perceptions. The results which informed the 200 lux recommendation stem from only the first variable, painting illuminance. Here it was found (as shown in Figure \ref{fig:Loe}) that for factors christened `discrimination' and `quality evaluation' (distilled from factor analysis of the original semantic data) there was `a steep rise in discrimination and quality assessment until and illuminance of approximately 200 lux is reached: above this illuminance the rate of increase in reduced.' This conclusion has had substantial impact in setting guidelines and future thinking was that a minimum of 200 lux was required to `give visual satisfaction', however it can be seen from Figure \ref{fig:Loe} that the data is sparse, noisy, dependent upon brand of light source and doesn't show a particularly strong effect of 200 lux in particular. Further, only a small number of different luminances were sampled, and it is quite possible that the results are at the mercy of several types of bias \citep{fotios_research_2009}. The value of 200 lux was subsequently used in \citet{thomson_museum_1978}, which has informed a great deal of subsequent thinking on the topic. \begin{figure}[htbp] \includegraphics[max width=\textwidth]{figs/LitRev/Loe.png} @@ -438,7 +438,7 @@ \subsection{CCT in Museums} \label{fig:Kruithof} \end{figure} -The damage justification seems more substantive; following the application of damage factors as discussed in Section \ref{sec:DamageIndex} the \gls{CIE} published a report showing the varying the \gls{CCT} of museum lighting could have a clear impact on the potential damage undergone by museum objects \citep{cie_cie_2004}. They key figure is reproduced here as Figure \ref{fig:CIE2004}. +The damage justification seems more substantive; following the application of damage factors as discussed in Section \ref{sec:DamageIndex} the \gls{CIE} published a report showing the varying the \gls{CCT} of museum lighting could have a clear impact on the potential damage undergone by museum objects \citep{cie_cie_2004}. The key figure is reproduced here as Figure \ref{fig:CIE2004}. \begin{figure}[hbtp] \includegraphics[max width=\textwidth]{figs/LitRev/CIE2004.png} diff --git a/SmallSphere.tex b/SmallSphere.tex index 87b0e9c..b6ff537 100644 --- a/SmallSphere.tex +++ b/SmallSphere.tex @@ -8,7 +8,7 @@ \section{Summary} This experiment was performed to develop upon the Large Sphere experiment (Chapter \ref{chap:LargeSphere}) by narrowing down the number of variables and more directly exploring the question of whether melanopsin plays a role in colour constancy. Observers were adapted to one of two perceptually metameric conditions, one with a high melanopic content and one with a low melanopic content. -It was predicted that if \glspl{ipRGC} played a role in chromatic adaptation or colour constancy that we would different achromatic settings for the mel-low and mel-high conditions. No prediction was made regarding the magnitude or direction of the effect. +It was predicted that if \glspl{ipRGC} played a role in chromatic adaptation or colour constancy that we would see different achromatic settings for the mel-low and mel-high conditions. No prediction was made regarding the magnitude or direction of the effect. Statistically significant but low magnitude differences were found between conditions for two out of three observers. For the two observers who performed repeated trials, inter-trial variability was high, and of a similar magnitude to inter-condition differences. One observer provided drastically different responses during the repeat sessions; hardware issues which may cause such a difference are discounted, and remaining hypotheses for what may have caused such a large distinction are discussed. @@ -165,7 +165,7 @@ \subsubsection{Perceptual Nulling of Peripheral Adapting Field} \label{sec:null} Observers found this task rather arduous, predominantly due to the inherent difficulty in making colour matches in the periphery. An additional difficulty was that since eye movements were not strictly controlled, if an observer were to look away briefly from the fixation they would be able to see the adapting field with their foveal vision. This was problematic since in most cases the peripheral matches induced strong contrast for foveal perception. Though it was unintentional, this seems to be a particularly effective way of generating the perception of a Maxwell spot \citep{isobe_functional_1955}. Further to this, the authors' experience was that the visible periphery could be further divided, by eccentricity, into two or possibly three areas where a match in one area would not provide a match in both areas. -Despite these difficulties, observers generally found settings which for them resulted in a metameric match (where they could no longer perceive flicker, or perceived very little flicker). It should be noted that whilst perceptual matches were found, it should not be expected for these matches to also be colorimetric matches for either of the \gls{CIE} 2$^{\circ}$ or 10$^{\circ}$ observers, as these matches are being made at greater eccentricities than those represented by the \gls{CIE} standard observers, and it can be expected that the functional spectral sensitivities of non-foveal receptors differ substantially from foveal and parafoveal receptors, if only due to pre-retinal filtering. The perceptual differences for foveal vision were large, as evidenced by the appearance of Maxwell spots. The chromaticities for the chosen illuminations are plotted in Figure \ref{fig:SSLEDs}. +Despite these difficulties, observers generally found settings which for them resulted in a metameric match (where they could no longer perceive flicker, or perceived very little flicker). It should be noted that whilst perceptual matches were found, it should not be expected that these matches also be colorimetric matches for either of the \gls{CIE} 2$^{\circ}$ or 10$^{\circ}$ observers, as these matches are being made at greater eccentricities than those represented by the \gls{CIE} standard observers, and it can be expected that the functional spectral sensitivities of non-foveal receptors differ substantially from foveal and parafoveal receptors, if only due to pre-retinal filtering. The perceptual differences for foveal vision were large, as evidenced by the appearance of Maxwell spots. The chromaticities for the chosen illuminations are plotted in Figure \ref{fig:SSLEDs}. One observer who initially agreed to take part in this study withdrew at this stage, partly due to a difficulty completing this task, but mainly due to a claustrophobic reaction. Another potential observer withdrew at this stage, since he was unable to make a match using this set of primaries, which we tentatively attribute to incipient cataracts. @@ -177,7 +177,7 @@ \subsubsection{Achromatic Selections} 3 observers took part in the main experiment (the author (DG), HC, and LW). -The task was identical to that performed in the Large Sphere experiment; using two sliders (controlling the yellow/blue component and the red/green component) to set the foveal stimulus to appear achromatic. The instruction was given to set the central disc such that it appeared not red, green, blue or yellow. Once happy with their selection the observer was to press a button, at which point they would be presented with a new random colour. The same starting condition as was used for the large sphere was used. +The task was identical to that performed in the Large Sphere experiment; using two sliders (controlling the yellow/blue component and the red/green component) to set the foveal stimulus to appear achromatic. The instruction was given to set the central disc such that it appeared not red, green, blue or yellow. Once happy with their selection the observer was to press a button, at which point they would be presented with a new random colour. The same starting condition as for the large sphere experiment was used. As previously noted, instead of 10 runs of L* 85 descending in 5* increments to L* 10, there were 30 runs of a pseudo-randomly permuted (each run) set of stimuli specified such that there was one at every 10 L* interval between 30 L* and 70 L*. The range was reduced so as to minimise the impact of gamut-boundary issues. The L* interval was increased to allow for a greater number of repetitions of specific values within a similar time frame. The order was pseudo-randomly permuted to avoid any trend based effects. @@ -286,7 +286,7 @@ \section{Discussion} For observer LW there were not significant differences between the different conditions, but there was a large magnitude difference between the repeat conditions (See Figure \ref{fig:SSsummary} or \ref{fig:SS_LW}). To be clear - with a single day separating inter-condition trials, this observer exhibited no difference between conditions, but after roughly three months, when returning to do a second pair of trials (again with a single day separating) the results were strikingly different. This is particularly unusual considering how well matched the inter-condition responses are; if it were just the case that this particular observer was particularly unreliable in their selections (and their data does exhibit generally quite high standard deviations, see Table \ref{tab:SS}) then I posit that they would be as unlikely to be able to repeat their selections after a break of a day as they would be after a break of three months. -The differences cannot readily be explained by hardware issues; variation in the surround illumination and screen output are minimal between sessions. Further, the same level of hardware variations would have been present for both observer LW and observer HC, and no such dramatic shift is seen for HC's data. +The differences cannot readily be explained by hardware issues; variation in the surround illumination and screen output are minimal between sessions. Further, the same level of hardware variation would have been present for both observer LW and observer HC, and no such dramatic shift is seen for HC's data. Regarding Figure \ref{fig:SSLEDs2}, which shows the chromaticities of the peripheral illumination, it can be seen that there was some variation between repeated conditions, and also a small amount of variation within each session. The variation across sessions is likely due to physical disturbance of the equipment (either the measurement device or the illumination source) and is of a relatively minor magnitude. The variation within session seems to be systematic, perhaps relating to warm-up time of the illumination source, with the chromaticity being quite variable for the first few minutes of several trials before gaining stability. diff --git a/TabletMethod.tex b/TabletMethod.tex index c4c2f21..54d9089 100644 --- a/TabletMethod.tex +++ b/TabletMethod.tex @@ -234,7 +234,7 @@ \subsubsection{Impact of ambient illumination} \label{sec:ambient} For values above 75 (inclusive), a conservative estimate for the maximum shifts in chromaticity due to variation between light sources (considering only those sources tested) would be roughly 0.004 in the u' axis, and 0.009 in the v' axis. These values are derived from visual inspection of the variation in values of chromaticity for readings taken of pixel values above 75. These figures could be considered baseline figures for classifying observed differences as likely to originate from genuine changes in observer state rather than lighting/stimulus artefacts. -It is noted that the variation between the repeated measurements, denoted `WW' and `WW2', is larger than might be expected; at high pixel values the chromaticities recorded under `CW', `MH' and `WW2' converge very well, but `WW' seems offset by roughly 0.005 units in a roughly north-east direction in colour space. The cause of this is unclear. The cause could be the result of `warm up' (either in terms of an actual temperature dependency, or in terms of a device taking time to settle into a default operating mode after turn on) of either the screen or the spectroradiometer. It could also be the case that between measurements the angle of the screen relative to the spectroradiometer changed and that this was the cause of the distinction. For this type of display it is well known that there are generally significant effects of angle of view. No attempt was made to force participants to hold the tablet at a specific angle, assuming that observers would naturally hold the tablet in a manner which would place it perpendicularly to the line of view. Any attempt to force a specific viewing angle would have limited the accessibility of this methodology. +It is noted that the variation between the repeated measurements, denoted `WW' and `WW2', is larger than might be expected; at high pixel values the chromaticities recorded under `CW', `MH' and `WW2' converge very well, but `WW' seems offset by roughly 0.005 units in a roughly north-east direction in colour space. The cause of this is unclear. The cause could be the result of `warm up' (either in terms of an actual temperature dependency, or in terms of a device taking time to settle into a default operating mode after turn on) of either the screen or the spectroradiometer. It could also be the case that between measurements the angle of the screen relative to the spectroradiometer changed and that this was the cause of the distinction. For this type of display it is well known that there are generally significant effects of angle of view. No attempt was made to force participants to hold the tablet at a specific angle, assuming that observers would naturally hold the tablet perpendicular to the line of view. Any attempt to force a specific viewing angle would have limited the accessibility of this methodology. % ----------% This is all well and good but not required. % Consulting the spectral data for `WW' and `WW2' (Figure X%!!!!!!!!!!! diff --git a/ipRGCs.tex b/ipRGCs.tex index ecef82a..c51dd8f 100644 --- a/ipRGCs.tex +++ b/ipRGCs.tex @@ -43,7 +43,7 @@ \section{Intrinsically Photosensitive Retinal Ganglion Cells (ipRGCs)} \label{fig:melspeed} \end{figure} -\Glspl{ipRGC} vary greatly in the range of light intensities that they are sensitive, are unimodal (stop responding above a certain threshold), and as a population their sensitivity spans a large range of lights levels \citep{do_melanopsin_2019}. It has been proposed that these properties \glspl{ipRGC} would allow an observer to efficiently sense a level of absolute irradiance \citep{brown_melanopsin_2010,milner_population_2017} (restricted to the wavelengths which ipRGCs and their inputs are sensitive to). +\Glspl{ipRGC} vary greatly in the range of light intensities that they are sensitive to, are unimodal (stop responding above a certain threshold), and as a population their sensitivity spans a large range of light levels \citep{do_melanopsin_2019}. It has been proposed that these properties \glspl{ipRGC} would allow an observer to efficiently sense a level of absolute irradiance \citep{brown_melanopsin_2010,milner_population_2017} (restricted to the wavelengths which ipRGCs and their inputs are sensitive to). \subsection{Synaptic Input} @@ -67,7 +67,7 @@ \subsection{Synaptic Input} ON bipolar cells use two unconventional strategies to release glutamate onto the dendrites of SCN-projecting mouse ipRGCs in the ``OFF'' sublamina. Some ON bipolar cells' axons extend lateral protrusions that contain synaptic vesicles [...], whereas others possess en passant (in passing) synaptic vesicles within their axonal shafts [\citet{dumitrescu_ectopic_2009}]. Distally stratifying ipRGCs are also present in rabbit, marmoset and macaque retinas, and they likewise receive unconventional ON bipolar input in the ``OFF'' sublamina [...] [\citet{hoshi_inputs_2009}, \citet{grunert_bipolar_2011}]. \end{itquote} -Signals from rods and cones retain their traditional time courses; \glspl{ipRGC} are not inherently sluggish, rather the melanopic inputs to \glspl{ipRGC} are. This can be seen in Figure \ref{fig:wong}, where standard outputs of an \gls{ipRGC} are shown on the left, and outputs with rod/cone driven synaptic inputs blocked are shown on the right. The response is shown to be relatively instantaneous for the cell with intact inputs, but lagging by several seconds for the cell relying on melanoptic activation alone. +Signals from rods and cones retain their traditional time courses; \glspl{ipRGC} are not inherently sluggish, rather the melanopic inputs to \glspl{ipRGC} are. This can be seen in Figure \ref{fig:wong}, where standard outputs of an \gls{ipRGC} are shown on the left, and outputs with rod/cone driven synaptic inputs blocked are shown on the right. The response is shown to be relatively instantaneous for the cell with intact inputs, but lagging by several seconds for the cell relying on melanopic activation alone. \begin{figure}[htbp] \includegraphics[max width=\textwidth, center]{figs/LitRev/wong.png} @@ -75,7 +75,7 @@ \subsection{Synaptic Input} \label{fig:wong} \end{figure} -There also evidence for \glspl{ipRGC} having intraretinal retrograde synaptic output (\citet{zhang_intraretinal_2008,zhang_melanopsin_2012}, summarised by \citet{graham_melanopsin-expressing_2016}), via a subpopulation of dopaminergic amacrine cells. This type of signalling could provide a feedback loop which modifies signals before they have left the retina. +There is also evidence for \glspl{ipRGC} having intraretinal retrograde synaptic output (\citet{zhang_intraretinal_2008,zhang_melanopsin_2012}, summarised by \citet{graham_melanopsin-expressing_2016}), via a subpopulation of dopaminergic amacrine cells. This type of signalling could provide a feedback loop which modifies signals before they have left the retina. \subsection{Projection} @@ -105,7 +105,7 @@ \subsection{The roles of ipRGCs beyond circadian entrainment} The authors conclude that melanopsin activation affects the parvocellular pathway to the extent that \gls{ipRGC} activation could be thought of as ``additive to the M-cone signal opposing the L-cone signal in the PC pathway [i.e., L - (M + I)] (where ``I'' for melanopsin activation in ipRGCs) to signal greenness and/or blueness''. -The authors note that this corresponds to an earlier result from one of the same authors \citep{barrionuevo_contributions_2014} where such a contribution set was proposed. However, the earlier result includes rod contributions, and the specific pathway which they must be referring to is only the 5th component accounting for $<0.01\%$ of the variance in the signals under examination. Meanwhile, no evidence is found for the 2nd component from that same analysis (labelled as konioncellular, representing $1.56\%$ of variance), which they also proposed would have a considerable melanopic contribution contribution. They neglect to mention this in the later paper. +The authors note that this corresponds to an earlier result from one of the same authors \citep{barrionuevo_contributions_2014} where such a contribution set was proposed. However, the earlier result includes rod contributions, and the specific pathway which they must be referring to is only the 5th component accounting for $<0.01\%$ of the variance in the signals under examination. Meanwhile, no evidence is found for the 2nd component from that same analysis (labelled as konioncellular, representing $1.56\%$ of variance), which they also proposed would have a considerable melanopic contribution. They neglect to mention this in the later paper. \begin{figure}[htbp] \includegraphics[max width=\textwidth, center]{figs/LitRev/cao.png} @@ -140,15 +140,15 @@ \subsection{Value for colour constancy} \emph{In this section I shall outline the reasoning which suggests to me that there might be value in a melanopic input for attaining colour constancy.} -Existing colour constancy algorithms fundamentally rely on the ability of cone-receptor-based signals to calibrate cone-receptor-based signals. In this context, by \emph{calibrate} I mean \emph{modify a raw signal in order to exclude unwanted signal, in order to improve the accuracy (and possibly also precision) of target signal measurement} where the \emph{unwanted signal} would be variation in illumination, and the target signal would be either the \gls{SRF} of a surface or some other identifier of the surface. +Existing colour constancy algorithms fundamentally rely on the ability of cone-receptor-based signals to calibrate cone-receptor-based signals. In this context, by \emph{calibrate} I mean \emph{modify a raw signal in order to exclude unwanted elements of the signal, in order to improve the accuracy (and possibly also precision) of target signal measurement} where the \emph{unwanted signal} would be variation in illumination, and the \emph{target signal} would be either the \gls{SRF} of a surface or some other identifier of the surface. -This general framework suffers from what I refer to as the issue of circularity in self-calibration\footnote{I suspect that this issue has been discussed in other fields but I have been unable to find such discussion as of yet.}. Generally calibration is performed by characterising a sensor through measurement of an object where the ground truth is known (and/or a measurement from a trusted secondary sensor has been made of this object), and adjusting the properties of the sensor (either at the measurement stage or by implementing a post-processing stage) such that a measurement of the known object results in the expected values. In the case outlined above (cone-receptor-based signals calibrating cone-receptor-based signals), there is no ground truth object, and no secondary sensor, and thus calibration in the traditional sense fundamentally cannot be performed. +This general framework suffers from what I refer to as the issue of circularity in self-calibration\footnote{I suspect that this issue has been discussed in other fields but I have been unable to find such discussion as of yet.}. Generally calibration is performed by characterising a sensor through measurement of an object where the ground truth is known (and/or a measurement from a trusted secondary sensor has been made of this object), then adjusting the properties of the sensor (either at the measurement stage or by implementing a post-processing stage) such that a measurement of the known object results in the expected values. In the case outlined above (cone-receptor-based signals calibrating cone-receptor-based signals), there is no ground truth object, and no secondary sensor, and thus calibration in the traditional sense fundamentally cannot be performed. If only relative signals are of importance (as opposed to absolute value measurements), then an uncalibrated system might achieve satisfactory stability through the use of measurements taken over time or over space from a single sensor. A melanopic signal could represent a secondary signal, and the properties of \glspl{ipRGC} seem to make them well-suited for making measurements where the ambient illumination is preferentially detected over transient \glspl{SRF}. Particular properties will be discussed below. -If one's goal was to design a sensor which measured the ambient illumination upon a scene (and was only minimally perturbed by surface reflectances) it might be wise to limit both the spatial and temporal resolution relative to sensors which may be best for measuring surfaces, since the lighting on a scene generally operates at spatial and temporal frequencies which are both lower than surface variation within a scene, particularly when the scene is not viewed from a static position but from a constantly changing vantage (such as is the case with human vision, where the observer is moving body, face direction, and gaze direction regularly). It would also be ideal if the secondary sensor was not strongly adaptive, as this would allow for a more concrete relationship between stimuli and response. \Glspl{ipRGC} exhibit all of the above properties. +If one's goal was to design a sensor which measured the ambient illumination upon a scene (and was only minimally perturbed by surface reflectances) it might be wise to limit both the spatial and temporal resolution relative to sensors which may be best for measuring surfaces, since the lighting on a scene generally operates at spatial and temporal frequencies which are both lower than surface variation within a scene, particularly when the scene is not viewed from a static position but from a constantly changing vantage (such as is the case with human vision, where the observer is moving their body, face direction, and gaze direction regularly). It would also be ideal if the secondary sensor was not strongly adaptive, as this would allow for a more concrete relationship between stimuli and response. \Glspl{ipRGC} exhibit all of the above properties. There are multiple sites at which a melanopsin-based calibration could occur. The synaptic connections to \glspl{ipRGC} from rods and cones could allow a melanopsin-dependent transform to be performed at the \gls{RGC} stage before signals are output. Alternatively, the intraretinal outputs from \glspl{ipRGC} could allow for modification of signals before reception by traditional \glspl{RGC}. Finally, calibration could occur at any higher post-retinal location assuming that melanopic and cone-based signals could be reconstructed at that point. diff --git a/melcomp.tex b/melcomp.tex index 99aa8a2..5489f15 100644 --- a/melcomp.tex +++ b/melcomp.tex @@ -517,11 +517,11 @@ \section{Implications for future research} The target variable in many previous studies has been melanopic activation. No clear route has been shown here which would indicate a mechanism by which a raw melanopic signal could be used, to the extent that a melanopic signal cannot predict the chromaticity of daylight. A more plausible candidate at this stage is a normalised melanopsin value of some sort. The practical implication of this is that the need to control luminanance and other cone/rod signals is paramount. If it transpires that a raw melanopsin signal \emph{is} used, then there is no harm done by following this suggestion. -In order to assess whether melanopsin is involved in colour constancy at a full system level, a more holistic test than achromatic matching is required. Colour naming or discrimination of illuminant change from reflectance change seem clear candidates, as both use semi-natural tasks that, under best circumstances, would require an observer to use the full extent of their visual system. +In order to assess whether melanopsin is involved in colour constancy at a full system level, a more holistic test than achromatic matching is required. Colour naming or discrimination of illuminant change from reflectance change seem clear candidates, as both use semi-natural tasks that, under the best circumstances, would require an observer to use the full extent of their visual system. -It is possible that the use of naturalistic contrasts may be important. For example, assuming there are multiple cues which are used to enable colour constancy, even if a melanopic process is one, it is possible that it may be `overruled' if multiple other mechanisms suggest a different conclusion to that which would be gained from using the melanopic process alone. To be clear - it seems possible that there might be a naturalistic sweet-spot, too little melanopic activation clearly won't activate any melanopic processes, but it is possible that \emph{too much} melanopic activation, relative to other visual signals, may also result in a non-representative finding. \citet{allen_form_2019} took a step in this direction by using the hyperspectral images of Foster et al., discussed in Section \ref{sec:surfs} to understand the levels of melanopic contrast which exist in real scenes. +It is possible that the use of naturalistic contrasts may be important. For example, assuming there are multiple cues which are used to enable colour constancy, even if a melanopic process is one, it is possible that it may be `overruled' if multiple other mechanisms suggest a different conclusion to that which would be gained from using the melanopic process alone. To be clear - it seems possible that there might be a naturalistic sweet-spot, too little melanopic activation clearly won't activate any melanopic processes, but it is possible that \emph{too much} melanopic activation, relative to other visual signals, may also result in a non-representative finding. \citet{allen_form_2019} took a step in this direction by using the hyperspectral images of Foster et al., discussed in Section \ref{sec:surfs}, to understand the levels of melanopic contrast which exist in real scenes. -Considering the available daylight datasets\footnote{I suspect that existing daylight datasets downplay the importance of the variability of inter-reflections from surroundings. Specifically, when moving through forest environments I suspect that there is a great deal more variation in a red/green direction than would be suggested from daylight datasets taken from a single unshaded position.} there appears to a single primary axis of chromatic variation. It is to be expected, based upon ecological requirements but also our own experience of the world (where constancy seems effective), that constancy would be best suited to this type of variation. All other types of adaptation would seem substantially less important, if judged on the magnitude of the effect they hope to nullify alone\footnote{It is of course possible that there are specific surfaces for which constancy is vitally important, and that these specific surfaces may vary along subtly different vectors than the primary vector along the caerulean line.}. Thus it seems wise to prioritise testing of adaptation along this specific vector, with other vectors being of secondary concern. +Considering the available daylight datasets\footnote{I suspect that existing daylight datasets downplay the importance of the variability of inter-reflections from surroundings. Specifically, when moving through forest environments I suspect that there is a great deal more variation in a red/green direction than would be suggested from daylight datasets taken from a single unshaded position.} there appears to be a single primary axis of chromatic variation. It is to be expected, based upon ecological requirements but also our own experience of the world (where constancy seems effective), that constancy would be best suited to this type of variation. All other types of adaptation would seem substantially less important, if judged on the magnitude of the effect they hope to nullify alone\footnote{It is of course possible that there are specific surfaces for which constancy is vitally important, and that these specific surfaces may vary along subtly different vectors than the primary vector along the caerulean line.}. Thus it seems wise to prioritise testing of adaptation along this specific vector, with other vectors being of secondary concern. \clearpage