Deep Learning on Satellite Imagery

Deep learning transformed satellite image analysis by learning features instead of hand-crafting them. Convolutional networks — and now transformer architectures — read imagery the way trained interpreters do: from texture, shape and context, not just per-pixel spectra. Semantic segmentation models delineate buildings, roads, water and crops pixel by pixel; detection models find discrete objects; change networks compare dates. At continental scale, they do in days what manual digitisation could never finish.

The architectures that matter

Semantic segmentation is the mapping workhorse: encoder–decoder networks in the U-Net lineage classify every pixel, producing mask layers that vectorise into GIS features. Instance segmentation separates touching objects (adjacent buildings); object detection boxes discrete targets (vehicles, ships, aircraft); Siamese networks compare image pairs for change.

Vision transformers and geospatial foundation models — pretrained on massive unlabelled archives — increasingly provide the backbone, cutting the labelled-data cost of each new task.

What makes imagery different from photos

Satellite scenes are huge (tiling and stitching strategies matter), multispectral (networks can ingest NIR and SWIR bands photos lack), georeferenced (outputs must be too), and viewed from above (no canonical “up”, so rotation augmentation is standard). Resolution varies by an order of magnitude across sensors, and labels must align to pixels precisely.

These specifics reward geospatially literate ML teams; generic vision pipelines stumble on exactly these seams.

The production reality

Model quality is mostly training-data quality: consistent annotation, hard examples, geographic diversity. Inference at scale is engineering: tiling, edge effects, post-processing (regularising building polygons, snapping road topology) and merging into seamless layers.

And accuracy must be proven per deployment — confusion metrics on independent areas, not leaderboard numbers — before outputs feed decisions.

Frequently asked questions

How much training data does a segmentation model need?
From a few thousand annotated image chips for fine-tuning pretrained backbones to hundreds of thousands for training from scratch. Foundation-model pretraining keeps shrinking the labelled requirement — but never to zero, and never without geographic diversity.
Can deep learning work on free Sentinel imagery?
Yes — at 10 m it excels at land cover, crops, water and large-structure mapping. Building-level extraction, however, needs sub-metre commercial imagery; resolution bounds what any model can resolve.
Related Topics
Need This Done Professionally?
More in GeoAI & Machine Learning

Keep learning

GeoAI: Where Machine Learning Meets GIS

What GeoAI covers — from feature extraction to prediction — and what it takes to make machine learning work on spatial problems.

Read the article →

Training Data and Annotation for Geospatial AI

Why labelled data decides model quality, how geospatial annotation is done well, and what quality control looks like.

Read the article →

NDVI and Spectral Indices: The Arithmetic of Earth Observation

How simple band ratios like NDVI quantify vegetation, water, soil and burn severity — and how to use them without fooling yourself.

Read the article →

Cloud Geospatial Platforms: Google Earth Engine and Beyond

How planetary-scale cloud platforms changed Earth-observation analysis — data next to compute, and what that enables.

Read the article →

Put this knowledge to work

Every encyclopedia topic maps to a production service we deliver worldwide. Tell us what you're building.

Request a Free Quote
Have a project in mind? Proposal within 48 hours.Get a Quote