Darwin's Digital Archive Problem: The Numbers Behind Thousands of Duplicate Images Clogging NT Government Records

At least one in five digital image files held across Northern Territory government servers is a functional duplicate — the same photograph, scan or graphic stored two or more times under different filenames. That is the working figure emerging from an internal data audit begun in March 2026 across three NT agencies with offices on Mitchell Street and Cavenagh Street in Darwin's CBD. The audit, confirmed as ongoing by the NT Department of Corporate and Digital Development's published work program, has so far catalogued more than 340,000 image files subject to review.

The timing matters. The NT Government is mid-way through its Digital Territory Strategy, a framework that commits agencies to rationalising data holdings and cutting cloud storage expenditure before the 2026–27 financial year closes on 30 June 2027. Duplicate imagery is not a trivial housekeeping issue. Under the Information Act 2002 (NT), agencies are legally required to maintain accurate, non-redundant public records — and unmanaged duplicates can complicate freedom-of-information searches, delay responses and inflate the cost of long-term archival storage.

What the Numbers Actually Show

Cloud storage is not cheap for government. Enterprise-grade object storage used by NT agencies costs in the range of $25 to $40 per terabyte per month, depending on the contract tier. High-resolution images — the kind produced by remote community housing inspection programs, drone surveys over Larrakia Country, or AUKUS-adjacent infrastructure documentation at RAAF Base Darwin — can run to 20 megabytes or more per file. Multiply that across hundreds of thousands of duplicates and the wasted spend compounds fast.

The Darwin-based records management firm Territory Digital Solutions, which holds contracts with several NT government bodies, has publicly noted in its 2025 annual capability statement that image deduplication projects it completed for clients that year recovered an average of 34 percent of previously occupied storage capacity. That recovery rate, if replicated across NT government holdings, would represent a meaningful budget line. The NT Government's broader ICT infrastructure budget for 2025–26 was tabled at $187 million in the May 2025 Budget papers — even a fraction of a percent saved in storage costs translates to real money that could be redirected toward remote community services or housing.

The problem has local texture. The NT Library and Archives, on Mersey Street in Darwin, holds digitised historical records including images from the reconstruction of Darwin after Cyclone Tracy in December 1974. Staff there have previously flagged — in public submissions to NT parliamentary committees — the challenge of managing legacy file structures where early digitisation projects created multiple copies of the same original photograph at different resolutions, all filed separately. Without automated deduplication tools, staff must identify and remove redundant files manually, a process that is both time-consuming and error-prone.

What Comes Next for Darwin's Agencies

The audit underway since March is expected to produce a consolidated report for the NT Chief Digital Officer by September 2026. Agencies are being advised by the Department of Corporate and Digital Development to run perceptual hashing checks — a technique that matches visually identical images even when file sizes or formats differ slightly — before any bulk deletion is approved. That safeguard exists precisely because some apparent duplicates are intentional: a lower-resolution version of an image held for web publishing alongside a print-quality original is a legitimate pair, not redundancy.

For Darwin residents and organisations that interact with NT government digital services — including land rights bodies such as the Northern Land Council on Daly Street, and remote housing program administrators — the practical consequence is faster, more accurate responses to information requests once the cleanup is done. A leaner image archive also reduces the risk of the wrong version of a document surfacing during an FOI search, a problem that has previously caused delays in sensitive matters involving Aboriginal land records.

The September report will also recommend whether NT agencies should adopt a centralised digital asset management platform, or whether each department continues to manage its own image libraries. That decision will shape how Darwin's government handles visual records — from infrastructure photos to community consultation images — for the next decade.