Bitcoinmagazine

Did The New York Times Publish Manipulated Footage Of A Bitcoin Mine?
Level39
May 31, 2023
Footage accompanying a New York Times article critical of Bitcoin mining appears to have been manipulated to reinforce the paper’s bias.
https://bitcoinmagazine.com/culture/did-the-new-york-times-manipulate-bitcoin-mine-footage
This is an opinion editorial by Level39, a researcher focused on Bitcoin, technology, history, ethics and energy.
----------------------------------------------------------------------------------------------------
Did The New York Times manipulate aerial drone photography for its recent article attacking Bitcoin mining, in order to make the air in Rockdale, Texas appear smoggy?
On April 9, 2023, the paper published its article, "The Real-World Costs Of The Digital Race For Bitcoin[1]," which included attacks on Bitcoin miners who purchase energy through sanctioned demand-response programs [2] within the state’s energy grid.
https://bitcoinmagazine.com/.image/c_limit%2Ccs_srgb%2Cq_auto:good%2Cw_1400/MTk4MzEzOTk0NTY0NzQwOTQ5/comparison1.webp
[Sources: Twitter[3], nytimes.com[4]]
The article featured a sweeping hero video banner [5], which was also used as a still image for social media sharing, showing smog-filled aerial drone footage [6] over operations run by Bitdeer, a Bitcoin mining company that occupies a previously-abandoned aluminum smelting plant on the outskirts of Rockdale. However, evidence suggests that the footage may have either been manipulated [7] or lacks the necessary color grading that would have maintained photojournalistic integrity and adhered to ethical standards.
Links:
[1] https://www.nytimes.com/2023/04/09/business/bitcoin-mining-electricity-pollution.html
[2] https://www.ercot.com/services/programs/load/laar
[3] https://twitter.com/nytimes/status/1645551313068097537
[4] https://www.nytimes.com/2023/04/09/business/bitcoin-mining-electricity-pollution.html
[5] https://www.tributemedia.com/blog/what-is-a-hero-banner
[6] https://vp.nyt.com/video/2023/03/27/107205_1_bitcoin_wg_1080p.mp4
[7] https://youtu.be/oN-dFfRPEkg?t=95
----------------------------------------------------------------------------------------------------
Color Histograms And Image Manipulation
Color histograms are useful for analyzing the exposure and color balance of an image [1]. A color histogram is essentially a bar chart where the left side of the x-axis is black and the right side is white. The y-axis represents the number of pixels found in the image, for each part of the tonal scale between black and white. A properly exposed photograph, where the full spectrum of tonal blacks and whites are naturally found in a scene, will have pixels that span across the entire x-axis, from left to right [2]. When color data fails to span the entire x-axis, it can show that either those tones were entirely unavailable to the camera sensor, or that manipulation was performed to purposefully omit those colors.
In the side-by-side comparison below, the color histogram in the aerial footage published by the Times [3] (left) has no pixels approaching the black point. This is particularly strange for footage that has bright sun and stark shadows that are clearly visible as the camera moves over the scene. When color parameters are enhanced and corrected (as shown below in the version on the right), a brighter and more stunning scene emerges.
https://bitcoinmagazine.com/.image/c_limit%2Ccs_srgb%2Cq_auto:good%2Cw_1400/MTk4MzEzOTk0NTY0NjA5ODc3/sunny-comparison.webp
[The color histogram [4] for the image on the left, featured on The New York Times’ [5] website, has a distinct gap between its color data and its black point, possibly indicating either an improperly exposed image [6] or manipulation to add a smog effect [7]. The photo on the right has been color corrected, showing a normalized histogram with the full range of colors and indicating that the Times’ version seems to have been altered for effect.]
The hazy footage used by the Times may give readers a false impression that rural Texas air has been polluted by Bitcoin mining. Bitcon mines are fully electrified and, like electric vehicles [8], the mining facilities photographed by The Times have zero Scope 1 carbon emissions. In other words [9], there are no direct greenhouse (GHG) emissions [10] that occur from sources that are controlled or owned by the operators of the mines. Any indirect Scope 2 emissions [11] associated from mining’s energy use comes from the grid’s normal emissions.
Links:
[1] https://www.bhphotovideo.com/explora/photography/tips-and-solutions/how-to-read-your-cameras-histogram
[2] https://digital-photography-school.com/histograms-your-guide-to-proper-exposure/
[3] https://vp.nyt.com/video/2023/03/27/107205_1_bitcoin_wg_1080p.mp4
[4] https://en.wikipedia.org/wiki/Color_histogram
[5] https://www.nytimes.com/2023/04/09/business/bitcoin-mining-electricity-pollution.html
[6] https://digital-photography-school.com/rescuing-poorly-exposed-photos-with-photoshop-levels/
[7] https://youtu.be/oN-dFfRPEkg?t=95
[8] https://en.wikipedia.org/wiki/Zero-emissions_vehicle
[9] https://twitter.com/RiotPlatforms/status/1645473961004892162
[10] https://youtu.be/JKXeeiCa5Wg?t=1266
[11] https://www.epa.gov/climateleadership/scope-1-and-scope-2-inventory-guidance
----------------------------------------------------------------------------------------------------
Reply Hazy, Try Again
The alleged manipulation appears to have been indirectly confirmed by Jordan Vonderhaar, the freelance photographer who took the aerial footage in question. Vonderhaar published another photo from the same drone [1] flight on his personal website [2], showing that the weather was perfectly clear within moments of the hazy photo published by the Times. This clear photo, from a different angle, indicates that the missing color data in the hazy photo was not due to weather conditions.
https://bitcoinmagazine.com/.image/c_limit%2Ccs_srgb%2Cq_auto:good%2Cw_1400/MTk4MzEzOTk0NTY0ODA2NDg1/jordan-vonderhaar.webp
[Vonderhaar published a clear weather photo on his personal website [3], taken within minutes [4] of the photo that showed smog surrounding the same Bitdeer mine.]
Vonderhaar's clear and sunny photo was also featured on the front page of the Times’ print edition [5] (from April 11, 2023), with a color histogram that had similarities to the one found in the smoggy photo — another extended black point. Normalizing the black and white points on Vonderhaar's portfolio image reveals vibrant colors and a sunny morning in Rockdale. Notice in the side-by-side comparison below that the Times intentionally cropped out some of the blue skies when it published this particular shot:
https://bitcoinmagazine.com/.image/c_limit%2Ccs_srgb%2Cq_auto:good%2Cw_1400/MTk4MzEzOTk0NTY0NjA5ODc3/sunny-comparison.webp
[The image on the left was published on the April 11, 2023, front page of the Times’ print edition [6]. In addition to cropping out the blue skies, it appears to have had its black point extended, to wash out colors, as evidenced by the gap [7] between the color histogram data and the black point. Normalizing [8] the color histogram (right), brings out the full color spectrum.]
Vonderhaar’s photo on his portfolio site included full Exif metadata [9] that shows details about the imaging, such as the fact that it was taken on the morning of February 28, 2023, at 8:02 a.m. in raw [10] format, with a DJI FC220, the camera supplied by the DJI Mavic Pro drone [11].
Analysis of the shadows in the photo not only confirms this timing, but further analysis also indicates that the smoggy video footage [12] was taken only nine minutes after [13] the photo that showed clear and smog-free air surrounding the mine. Yet, the golden hues from the morning sunlight and blue skies are completely missing from the hazy hero footage. That a perfectly gorgeous moment in Rockdale could suddenly become hazy, at all altitudes and distances only nine minutes later, is nearly impossible.
https://bitcoinmagazine.com/.image/c_limit%2Ccs_srgb%2Cq_auto:good%2Cw_1400/MTk4MzEzOTk0NTY0NDEzMjY5/shadows-timing-2.webp
[Footage filmed nine minutes apart shows both clear weather and smog. Photos by Jordan Vonderhaar (top, middle), Shademap [14] (bottom), via @yeolddoc [15].]
Responding to allegations of manipulation, Vonderhaar — who described miners as “massive polluters [16]” — publicly stated on Twitter [17] that, “Nothing about the footage was doctored. It’s humid most mornings in Texas and when the sun rises you get low level haze. This is very common.”
Leaving aside for a moment that Vonderhaar appears to be admitting that he was perhaps intentionally seeking out hazy weather for his photojournalistic spread, the nearest automated weather observation station [18], located at Hearne Municipal Airport — 40 miles to the Northeast [19] and well out of view of the aerial photography — reported low-level fog [20] at that same moment.
Indeed, Vonderhaar's clear and sunny photo shows low-level fog on the distant horizon, many miles beyond Alcoa Lake. “Low-level” fog is not a high-altitude phenomenon, and sure enough, Vonderhaar's photo shows blue skies in the upper atmosphere and golden hues that are conspicuously missing in his smoggy footage, taken a few minutes later.
----------------------------------------------------------------------------------------------------
Links:
[1] https://archive.ph/QVUQ9
[2] https://www.jordanvonderhaar.com/
[3] http://jordanvonderhaar.com/
[4] https://twitter.com/yeolddoc/status/1652079301553004545
[5] https://static01.nyt.com/images/2023/04/11/nytfrontpage/scan.pdf
[6] https://static01.nyt.com/images/2023/04/11/nytfrontpage/scan.pdf
[7] https://youtu.be/oN-dFfRPEkg?t=95
[8] https://digital-photography-school.com/rescuing-poorly-exposed-photos-with-photoshop-levels/
[9] https://archive.is/Bqamk
[10] https://en.wikipedia.org/wiki/Raw_image_format
[11] https://commons.wikimedia.org/wiki/Category:Taken_with_DJI_FC220
[12] https://vp.nyt.com/video/2023/03/27/107205_1_bitcoin_wg_1080p.mp4
[13] https://twitter.com/yeolddoc/status/1652079301553004545
[14] https://shademap.app/@30.56217,-97.07004,17.18778z,1677592959182t,0b,45p,0m!1677589048364!1677630432709,qMzAuNTYyNDIwLCAtOTcuMDY5OTQx!30.56242!-97.06994
[15] https://twitter.com/yeolddoc/status/1652079301553004545
[16] https://twitter.com/jordan_vondy/status/1645446668635058176
[17] https://twitter.com/jordan_vondy/status/1645455851006640130
[18] https://www.ncei.noaa.gov/products/land-based-station/automated-surface-weather-observing-systems
[19] https://www.google.com/maps/dir/Alcoa+Lake,+Texas/Hearne+Municipal+Airport,+Crennan+Ln,+Hearne,+Texas+77859,+United+States+Crennan+Ln,+Hearne,+TX+77859/@30.7454462,-97.0029044,11z/data=!3m1!4b1!4m13!4m12!1m5!1m1!1s0x8644565ac202de19:0x7acb102f329d74aa!2m2!1d-97.0565663!2d30.5768948!1m5!1m1!1s0x8645cfa9fc4816af:0x37f2f4dc3c4a3e63!2m2!1d-96.6193961!2d30.8697362
[20] https://weatherspark.com/h/d/145983/2023/2/28/Historical-Weather-on-Tuesday-February-28-2023-at-Hearne-Municipal-Airport-Texas-United-States
----------------------------------------------------------------------------------------------------
Problems Uncovered
Rory Highside [1] — a VFX artist who has expertise in CGI video effects [2] — was among the first to notice problems with the footage that the Times had used. Analyzing the video and color histograms, Highside suspected that either the color grading was mishandled or the color balance had been manipulated [3]. One of the most noticeable issues was that the “black point” was extended, which is indicative of footage that is washed out [4]. This was evidenced by the fact that, as colors approached black, there was a noticeable and unnatural gap between pitch black and the available color data where darker colors should be. Vonderhaar did not respond to these allegations on Twitter, and did not respond to questions about them by email.
https://bitcoinmagazine.com/.image/c_limit%2Ccs_srgb%2Cq_auto:good%2Cw_1400/MTk4MzEzOTk0NTY0NTQ0MzQx/manipulation.webp
[Analysis by Rory Highside [5] of Vonderhaar’s Times footage.]
Links:
[1] https://twitter.com/roryhighside
[2] https://youtu.be/MT9PA5EvMuo
[3] https://twitter.com/roryhighside/status/1645726015233351680
[4] https://photo.stackexchange.com/questions/18821/how-to-best-methods-to-correct-washed-out-jpegs
[5] https://twitter.com/roryhighside/status/1645726015233351680
----------------------------------------------------------------------------------------------------
The Hazy Truth Of Photojournalism
Determining truth in photojournalism is a murky endeavor. The raw footage captured by professional-grade digital cameras can be thought of as the digital version of undeveloped film. Camera sensors capture raw data, which retains maximum image information and flexibility [1] during post-processing, but requires processing and interpolation to produce an accurate final image. The photographer must adjust various parameters, such as contrast, white balance, exposure, and color saturation — meaning the photographer always has some artistic leeway in the final product. Color manipulations are trivial adjustments in post production. It only takes one slight adjustment [2] to wash out an image. Minor adjustments are very common, and typically not an issue. But, at the end of the process, photographers have to walk a fine line between enhancing an image for visual impact and maintaining its authenticity.
Links:
[1] https://www.loc.gov/preservation/digital/formats/fdd/fdd000241.shtml
[2] https://twitter.com/level39/status/1646204720963371014
----------------------------------------------------------------------------------------------------
Unedited Raw Drone Footage Is Visibly Hazy
There is perhaps an alternate explanation for why Vonderhaar’s video footage was so hazy and lacking in contrast, while his still photograph taken nine minutes earlier was sunny and cinematic. The FC220 camera on Vonderhaar’s DJI Mavic Pro drone is capable of capturing video footage in a logarithmic (log) color profile [1]. Raw log footage is a flat and low-contrast format — not intended for publishing — that preserves a wide dynamic range of details, which allows for greater flexibility during post-processing. Much like how negative film [2] has inverted colors that enable positive images to be developed, log video footage always appears hazy when its raw, unedited format isn’t properly color graded [3].It would be the photojournalist’s responsibility, then, to accurately map to the colors they witnessed in real life.
https://bitcoinmagazine.com/.image/c_limit%2Ccs_srgb%2Cq_auto:good%2Cw_1400/MTk4MzEzOTk0NTY0NDEyOTc0/color-grading.webp
[DJI drones can record in a logarithmic (log) color profile, which appears hazy if it isn’t color graded in post-processing [4]. Source: “Shooting In D-Log - DJI Mavic Pro [5].”]
To convert log footage to an accurate color profile, a process called “color grading” or “color correction” is typically performed [6]. This involves adjusting the image's color and tonal properties to achieve a more visually pleasing and accurate representation of the scene. The proper conversion from log [7] involves mapping the tonal values in the log footage to their corresponding values, such as with lookup tables, or LUTS, to color grade the final footage.
Vonderhaar could very well have been telling the truth when he claimed [8] that “Nothing about the footage was doctored.” Indeed, publishing unedited log footage without proper color grading would quite literally result in a misleading smog effect, without having to do anything. Doing this deliberately, of course, would be unethical if it intentionally misleads viewers into seeing smog that did not exist.
Photojournalists have a duty [9] to maintain journalistic integrity and adhere to ethical standards to truthfully convey the events they witnessed. While there is no definitive "correct" color to any image, intentionally misleading readers by failing to color grade log footage is a breach of ethical standards. Photojournalists must depict the scene as faithfully as possible, avoiding anything that might distort reality. Publishing raw and uncorrected video footage, which actively removes colors from a scene and creates a misleading smog effect, is effectively a passive form of photographic manipulation. If not manipulation, then it is an egregious example of Hanlon’s razor [10].
It should be noted that Vonderhaar’s lack of color grading may not be due to malice or even artistic bias. While a professional photographer who has expertise in color correcting raw still images [11] to JPEG may possess a solid foundation in color correction and a good understanding of color theory, it does not automatically mean they have the necessary skills to color grade log video footage. Color grading log video involves a different set of skills and considerations [12] compared to color correcting raw still images [13]. Expertise in video editing software and a specific understanding of the technical aspects of working with video formats — such as frame rates, codecs and color spaces — is a requirement to adeptly work with log footage. Managing temporal continuity and ensuring consistent color grading is critical to maintaining visual coherence. It’s entirely plausible that Vonderhaar was simply unable to color grade log video. But, whether it be malice or inability, the Times should issue a correction.
Links:
[1] https://www.dpreview.com/articles/4978813437/how-to-shoot-log-video-using-dji-s-d-log-color-profile
[2] https://en.wikipedia.org/wiki/Negative_(photography)
[3] https://youtu.be/pI9vIUwqLO0
[4] https://www.dpreview.com/articles/4978813437/how-to-shoot-log-video-using-dji-s-d-log-color-profile
[5] https://www.youtube.com/watch?v=ccPJWVTdyA8
[6] https://youtu.be/o1m4LQu6BGQ
[7] https://www.dpreview.com/articles/4978813437/how-to-shoot-log-video-using-dji-s-d-log-color-profile
[8] https://twitter.com/jordan_vondy/status/1645455851006640130
[9] https://nppa.org/resources/code-ethics
[10] https://en.wikipedia.org/wiki/Hanlon%27s_razor
[11] http://jordanvonderhaar.com/
[12] https://youtu.be/DBo3zsQq6mY
[13] https://youtu.be/mPvJkhnB4xg
----------------------------------------------------------------------------------------------------
The Signature Style Of The Times
The Times has a signature style for its photographs [1], where it typically darkens images when it wants to portray a somber or moody tone. However, an extended black point — resulting in washed out colors — is the direct opposite of this iconic style.
https://bitcoinmagazine.com/.image/c_limit%2Ccs_srgb%2Cq_auto:good%2Cw_1400/MTk4MzEzOTk0NTY0Njc1NDEz/nyt-signature-style-histogram.webp
[The Times’ signature photographic style [2] uses an extended white point that slightly darkens the image.]
----------------------------------------------------------------------------------------------------
Links:
[1] https://www.reddit.com/r/photography/comments/jz4ver/what_creates_a_new_york_timesstyle_photograph/
[2] https://www.nytimes.com/2020/11/22/world/europe/russia-stalin-gulag-kolyma-magadan.html
----------------------------------------------------------------------------------------------------
The Ethics Of Photo Manipulation
All photography requires some form of color correction. Minor stylistic choices aside, adjustments that actively mislead readers are unethical [1]. A 2015 article in the Times [2] about a World Press Photo research project, for instance, explained that photo editors cross an ethical line, which becomes explicit manipulation, when their processing obscures an image to create conditions that were not actually in the scene:
“The only point at which processing becomes manipulation is when the toning is so great — usually by transforming significant parts of an image to opaque black or white — that it obscures substantial detail.”
–“Debating The Rules And Ethics Of Digital Photojournalism [3],” The New York Times
According to Highside, the extent of the manipulation and our ability to restore the full color potential will remain unknown unless Vonderhaar releases his original raw footage. The Society of Professional Journalists (SPJ) recommends in its code of ethics [4] that journalists need to be proactive about addressing concerns and allegations of improper conduct:
“Ethical journalism means taking responsibility for one’s work and explaining one’s decisions to the public. Journalists should: Explain ethical choices and processes to audiences. Encourage a civil dialogue with the public about journalistic practices, coverage and news content. Respond quickly to questions about accuracy, clarity and fairness. Acknowledge mistakes and correct them promptly and prominently. Explain corrections and clarifications carefully and clearly. Expose unethical conduct in journalism, including within their organizations. Abide by the same high standards they expect of others.”
–SPJ code of ethics [5]
Despite the missing color data, which can only be sourced from Vonderhaar’s unreleased raw footage, Highside was able to partially restore the washed out footage to demonstrate what the imaging could have looked like if a proper color grading had been applied. The results are striking when compared alongside the video that was published by the Times:
https://cdn.jwplayer.com/previews/J0dequ6B
Intentionally deciding not to color grade or fully correct log footage is a breach of ethical standards in photojournalism. However, if it was due to lack of ability, it can still be considered a breach of ethical standards, particularly if the Times fails to correct the misinformation or take appropriate action to rectify the situation. A fundamental principle [6] of photojournalism is to provide an accurate and truthful representation of events. Misrepresenting the visual aspects of a scene goes against this principle and compromises the integrity of the profession. It undermines the credibility of photojournalists and the publication, it damages the reputation of the profession and erodes public trust in the media.
It’s unclear why the Times is seemingly motivated [7] to deliberately portray Bitcoin mining in such a negative light. It appears to fit a long pattern of distortions and bias [8] from the newspaper, which has become more evident to readers in recent years. When the public is being misled by photojournalists into believing a small and rural Texas town has thick smog typically found in populated and polluted cities, it’s necessary and appropriate to question the paper’s ethical choices.
Vonderhaar could clear up suspicions over his work by releasing the original raw log footage. This would allow members of the public to properly assess the color grading of the footage and reveal the true details that were present [9]. If indeed the log footage was intentionally left in a low contrast state, it would be an embarrassment for the Times.
Links:
[1] http://spj.org/ethicscode.asp
[2] https://archive.nytimes.com/lens.blogs.nytimes.com/2015/02/17/world-press-photo-manipulation-ethics-of-digital-photojournalism/
[3] https://archive.nytimes.com/lens.blogs.nytimes.com/2015/02/17/world-press-photo-manipulation-ethics-of-digital-photojournalism/
[4] http://spj.org/ethicscode.asp
[5] http://spj.org/ethicscode.asp
[6] https://nppa.org/resources/code-ethics
[7] https://bitcoinmagazine.com/culture/why-the-new-york-times-attacks-bitcoin
[8] https://www.thegrayladywinked.com/
[9] https://youtu.be/fG95ikKV_AE
----------------------------------------------------------------------------------------------------
This is a guest post by Level39. Opinions expressed are entirely their own and do not necessarily reflect those of BTC Inc or Bitcoin Magazine.