图像融合论文及代码整理最全大合集-Toy模板网

这篇具有很好参考价值的文章主要介绍了图像融合论文及代码整理最全大合集。希望对大家有所帮助。如果存在错误或未考虑完全的地方，请大家不吝赐教，您也可以点击"举报违法"按钮提交疑问。

最全图像融合论文及代码整理

News

[2022-07-29] 我们的综述论文《基于深度学习的图像融合方法综述》被《中国图象图形学报》正式接收！[论文下载]

Github项目地址：https://github.com/Linfeng-Tang/Image-Fusion （欢迎大家Start、 Fork、 Fellow一键三连哦~）

图像融合(Image Fusion)

多模图像融合(Multi-Modal Image Fusion)
- 红外和可见光图像融合(Infrared and visible image fusion)
- 医学图像融合(Medical image fusion)
数字摄影图像融合(Digital Photography Image Fusion)
- 多曝光图像融合(Multi-exposure image fusion)
- 多聚焦图像融合(Multi-focus image fusion)
遥感影像融合(Remote Sensing Image Fusion)
- 全色图像锐化(Pansharpening)
通用图像融合框架(General Image Fusion Framerwork)
综述(Survey)
数据集(Dataset)
评估指标(Evaluation Metric)
- 通用评估指标(General evaluation metric)
- 遥感影像融合评估指标
Citation

图像融合系列博客还有：

图像融合综述论文整理参见：图像融合综述论文整理
图像融合评估指标参见：红外和可见光图像融合评估指标
图像融合常用数据集整理参见：图像融合常用数据集整理
通用图像融合框架论文及代码整理参见：通用图像融合框架论文及代码整理
基于深度学习的红外和可见光图像融合论文及代码整理参见:基于深度学习的红外和可见光图像融合论文及代码整理
更加详细的红外和可见光图像融合代码参见：红外和可见光图像融合论文及代码整理
基于深度学习的多曝光图像融合论文及代码整理参见：基于深度学习的多曝光图像融合论文及代码整理
基于深度学习的多聚焦图像融合论文及代码整理参见：基于深度学习的多聚焦图像融合(Multi-focus Image Fusion)论文及代码整理
基于深度学习的全色图像锐化论文及代码整理参见：基于深度学习的全色图像锐化(Pansharpening)论文及代码整理
基于深度学习的医学图像融合论文及代码整理参见：基于深度学习的医学图像融合(Medical image fusion)论文及代码整理
彩色图像融合程序参见：彩色图像融合
SeAFusion:首个结合高级视觉任务的图像融合框架参见：SeAFusion:首个结合高级视觉任务的图像融合框架
DIVFusion:首个耦合互促低光增强&图像融合的框架参见：DIVFusion:首个耦合互促低光增强&图像融合的框架

多模图像融合(Multi-Modal Image Fusion)

红外和可见光图像融合(Infrared and visible image fusion)

方法	标题	论文	代码	发表期刊或会议	基础框架	监督范式	发表年份
DenseFuse	DenseFuse: A Fusion Approach to Infrared and Visible Images	Paper	Code	TIP	AE	自监督	2019
FusionGAN	FusionGAN: A generative adversarial network for infrared and visible image fusion	Paper	Code	InfFus	GAN	无监督	2019
DDcGAN	Learning a Generative Model for Fusing Infrared and Visible Images via Conditional Generative Adversarial Network with Dual Discriminators	Paper	Code	IJCAI	GAN	无监督	2019
NestFuse	NestFuse: An Infrared and Visible Image Fusion Architecture Based on Nest Connection and Spatial/Channel Attention Models	Paper	Code	TIM	AE	自监督	2020
DDcGAN	DDcGAN: A dual-discriminator conditional generative adversarial network for multi-resolution image fusion	Paper	Code	TIP	GAN	无监督	2020
RFN-Nest	RFN-Nest: An end-to-end residual fusion network for infrared and visible images	Paper	Code	InfFus	AE	自监督	2021
CSF	Classification Saliency-Based Rule for Visible and Infrared Image Fusion	Paper	Code	TCI	AE	自监督	2021
DRF	DRF: Disentangled Representation for Visible and Infrared Image Fusion	Paper	Code	TIM	AE	自监督	2021
SEDRFuse	SEDRFuse: A Symmetric Encoder–Decoder With Residual Block Network for Infrared and Visible Image Fusion	Paper	Code	TIM	AE	自监督	2021
MFEIF	Learning a Deep Multi-Scale Feature Ensemble and an Edge-Attention Guidance for Image Fusion	Paper	Code	TCSVT	AE	自监督	2021
Meta-Learning	Different Input Resolutions and Arbitrary Output Resolution: A Meta Learning-Based Deep Framework for Infrared and Visible Image Fusion	Paper		TIP	CNN	无监督	2021
RXDNFuse	RXDNFuse: A aggregated residual dense network for infrared and visible image fusion	Paper		InfFus	CNN	无监督	2021
STDFusionNet	STDFusionNet: An Infrared and Visible Image Fusion Network Based on Salient Target Detection	Paper	Code	TIM	CNN	无监督	2021
D2LE	A Bilevel Integrated Model With Data-Driven Layer Ensemble for Multi-Modality Image Fusion	Paper		TIP	CNN	无监督	2021
HAF	Searching a Hierarchically Aggregated Fusion Architecture for Fast Multi-Modality Image Fusion	Paper	Code	ACM MM	CNN	无监督	2021
SDDGAN	Semantic-supervised Infrared and Visible Image Fusion via a Dual-discriminator Generative Adversarial Network	Paper	Code	TMM	GAN	无监督	2021
Detail-GAN	Infrared and visible image fusion via detail preserving adversarial learning	Paper	Code	InfFus	GAN	无监督	2021
Perception-GAN	Image fusion based on generative adversarial network consistent with perception	Paper	Code	InfFus	GAN	无监督	2021
GAN-FM	GAN-FM: Infrared and Visible Image Fusion Using GAN With Full-Scale Skip Connection and Dual Markovian Discriminators	Paper	Code	TCI	GAN	无监督	2021
AttentionFGAN	AttentionFGAN: Infrared and Visible Image Fusion Using Attention-Based Generative Adversarial Networks	Paper		TMM	GAN	无监督	2021
GANMcC	GANMcC: A Generative Adversarial Network With Multiclassification Constraints for Infrared and Visible Image Fusion	Paper	Code	TIM	GAN	无监督	2021
MgAN-Fuse	Multigrained Attention Network for Infrared and Visible Image Fusion	Paper		TIM	GAN	无监督	2021
TC-GAN	Infrared and Visible Image Fusion via Texture Conditional Generative Adversarial Network	Paper		TCSVT	GAN	无监督	2021
TarDAL	Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detection	Paper	Code	CVPR	GAN	无监督	2022
RFNet	RFNet: Unsupervised Network for Mutually Reinforcing Multi-modal Image Registration and Fusion	Paper	Code	CVPR	CNN	无监督	2022
SeAFusion	Image fusion in the loop of high-level vision tasks: A semantic-aware real-time infrared and visible image fusion network	Paper	Code	InfFus	CNN	无监督	2022
PIAFusion	PIAFusion: A progressive infrared and visible image fusion network based on illumination aware	Paper	Code	InfFus	CNN	无监督	2022
UMF-CMGR	Unsupervised Misaligned Infrared and Visible Image Fusion via Cross-Modality Image Generation and Registration	Paper	Code	IJCAI	CNN	无监督	2022
DetFusion	DetFusion: A Detection-driven Infrared and Visible Image Fusion Network	Paper	Code	ACM MM	CNN	无监督	2022
DIVFusion	DIVFusion: Darkness-free infrared and visible image fusion	Paper	Code	InfFus	CNN	无监督	2023

医学图像融合(Medical image fusion)

方法	标题	论文	代码	发表期刊或会议	基础框架	监督范式	年份
CNN	A medical image fusion method based on convolutional neural networks	Paper		ICIF	CNN	无监督	2017
Zero-LMF	Zero-Learning Fast Medical Image Fusion	Paper	Code	ICIF	CNN	无监督	2019
DDcGAN	Learning a Generative Model for Fusing Infrared and Visible Images via Conditional Generative Adversarial Network with Dual Discriminators	Paper	Code	IJCAI	GAN	无监督	2019
GFPPC-GAN	Green Fluorescent Protein and Phase-Contrast Image Fusion via Generative Adversarial Networks	Paper		CMMM	GAN	无监督	2019
CCN-CP	Multi-modality medical image fusion using convolutional neural network and contrast pyramid	Paper		Sensors	CNN	无监督	2020
DDcGAN	DDcGAN: A Dual-Discriminator Conditional Generative Adversarial Network for Multi-Resolution Image Fusion	Paper	Code	TIP	GAN	无监督	2020
MGMDcGAN	Medical Image Fusion Using Multi-Generator Multi-Discriminator Conditional Generative Adversarial Network	Paper	Code	Access	GAN	无监督	2020
D2LE	A Bilevel Integrated Model With Data-Driven Layer Ensemble for Multi-Modality Image Fusion	Paper		TIP	CNN	无监督	2021
HAF	Searching a Hierarchically Aggregated Fusion Architecture for Fast Multi-Modality Image Fusion	Paper	Code	ACM MM	CNN	无监督	2021
EMFusion	EMFusion: An unsupervised enhanced medical image fusion network	Paper	Code	InfFus	CNN	无监督	2021
DPCN-Fusion	Green Fluorescent Protein and Phase Contrast Image Fusion Via Detail Preserving Cross Network	Paper	Code	TCI	CNN	无监督	2021
MSPRN	A multiscale residual pyramid attention network for medical image fusion	Paper	Code	BSPC	CNN	无监督	2021
DCGAN	Medical image fusion method based on dense block and deep convolutional generative adversarial network	Paper		NCA	GAN	无监督	2021

数字摄影图像融合(Digital Photography Image Fusion)

多曝光图像融合(Multi-exposure image fusion)

方法	标题	论文	代码	发表期刊或会议	基础框架	监督范式	年份
DeepFuse	DeepFuse: A Deep Unsupervised Approach for Exposure Fusion with Extreme Exposure Image Pairs	Paper	Code	ICCV	CNN	无监督	2017
CNN	Multi-exposure fusion with CNN features	Paper	Code	ICIP	CNN	无监督	2018
MEF-Net	Deep guided learning for fast multi-exposure image fusion	Paper	Code	TIP	CNN	无监督	2020
ICEN	Multi-exposure high dynamic range imaging with informative content enhanced network	Paper		NC	CNN	无监督	2020
MEF-GAN	MEF-GAN: Multi-Exposure Image Fusion via Generative Adversarial Networks	Paper	Code	TIP	GAN	无监督	2020
CF-Net	Deep coupled feedback network for joint exposure fusion and image super-resolutions	Paper	Code	TIP	CNN	无监督	2021
UMEF	Deep unsupervised learning based on color un-referenced loss functions for multi-exposure image fusion	Paper	Code	InFus	CNN	无监督	2021
PA-AGN	Two exposure fusion using prior-aware generative adversarial network	Paper		TMM	GAN	无监督	2021
AGAL	Attention-guided Global-local Adversarial Learning for Detail-preserving Multi-exposure Image Fusion	Paper	Code	TCSVT	GAN	无监督	2022
GANFuse	GANFuse: a novel multi-exposure image fusion method based on generative adversarial networks	Paper		NCAA	GAN	无监督	2021
DRLF	Automatic Intermediate Generation With Deep Reinforcement Learning for Robust Two-Exposure Image Fusion	Paper		TNNLS	CNN	无监督	2021
Trans-MEF	TransMEF: A Transformer-Based Multi-Exposure Image Fusion Framework using Self-Supervised Multi-Task Learning	Paper	Code	AAAI	AE	自监督	2022
DPE-MEF	Multi-exposure image fusion via deep perceptual enhancement	Paper	Code	InFus	CNN	无监督	2022

多聚焦图像融合(Multi-focus image fusion)

方法	标题	论文	代码	发表期刊或会议	基础框架	监督范式	年份
CNN	Multi-focus image fusion with a deep convolutional neural network	Paper	Code	InFus	CNN	有监督	2017
ECNN	Ensemble of CNN for multi-focus image fusion	Paper	Code	InFus	CNN	有监督	2019
MLFCNN	Multilevel features convolutional neural network for multifocus image fusion	Paper		TCI	CNN	有监督	2019
DRPL	DRPL: Deep Regression Pair Learning for Multi-Focus Image Fusion	Paper	Code	TIP	CNN	有监督	2020
MMF-Net	An α-Matte Boundary Defocus Model-Based Cascaded Network for Multi-Focus Image Fusion	Paper	Code	TCI	CNN	有监督	2020
MFF-SSIM	Towards Reducing Severe Defocus Spread Effects for Multi-Focus Image Fusion via an Optimization Based Strategy	Paper	Code	Sensors	CNN	无监督	2020
MFNet	Structural Similarity Loss for Learning to Fuse Multi-Focus Images	Paper		TIP	CNN	有监督	2021
GEU-Net	Global-Feature Encoding U-Net (GEU-Net) for Multi-Focus Image Fusion [GEU-Net	Paper	Code	TCI	CNN	自监督	2021
DTMNet	DTMNet: A Discrete Tchebichef Moments-Based Deep Neural Network for Multi-Focus Image Fusion	Paper		TMM	CNN	无监督	2021
SMFuse	SMFuse: Multi-Focus Image Fusion Via Self-Supervised Mask-Optimization	Paper	Code	NCA	CNN	无监督	2021
ACGAN	A generative adversarial network with adaptive constraints for multi-focus image fusion	Paper	Code	ICCV	GAN	有监督	2021
FuseGAN	Learning to fuse multi-focus image via conditional generative adversarial network	Paper		TIP	GAN	有监督	2020
D2FMIF	Depth-Distilled Multi-focus Image Fusion	Paper		TMM	CNN	有监督	2019
SESF-Fuse	SESF-Fuse: an unsupervised deep model for multi-focus image fusion	Paper	Code	NCAA	CNN	有监督	2020
MFF-GAN	MFF-GAN: An unsupervised generative adversarial network with adaptive and gradient joint constraints for multi-focus image fusion	Paper	Code	InFus	GAN	无监督	2021
MFIF-GAN	MFIF-GAN: A new generative adversarial network for multi-focus image fusion	Paper	Code	SPIC	GAN	有监督	2021

遥感影像融合(Remote Sensing Image Fusion)

全色图像锐化(Pansharpening)

方法	标题	论文	代码	发表期刊或会议	基础框架	监督范式	年份
PNN	Pansharpening by Convolutional Neural Networks	Paper	Code	RS	CNN	有监督	2016
PanNet	PanNet: A deep network architecture for pan-sharpening	Paper	Code	PanNet	CNN	有监督	2017
TFNet	Remote sensing image fusion based on two-stream fusion network	Paper	Code	TFNet	CNN	有监督	2020
BKL	Unsupervised Blur Kernel Learning for Pansharpening	Paper		IGARSS	CNN	无监督	2020
Pan-GAN	Pan-GAN: An unsupervised pan-sharpening method for remote sensing image fusion	Paper	Code	InFus	GAN	无监督	2020
UCNN	Pansharpening via Unsupervised Convolutional Neural Networks	Paper		JSTARS	CNN	无监督	2020
UPSNet	UPSNet: Unsupervised Pan-Sharpening Network With Registration Learning Between Panchromatic and Multi-Spectral Images	Paper		ACCESS	CNN	无监督	2020
GPPNN	Deep Gradient Projection Networks for Pan-sharpening	Paper	Code	CVPR	CNN	有监督	2021
GTP-PNet	GTP-PNet: A residual learning network based on gradient transformation prior for pansharpening	Paper	Code	ISPRS	CNN	有监督	2021
HMCNN	Pan-Sharpening Via High-Pass Modification Convolutional Neural Network	Paper	Code	ICIP	CNN	有监督	2021
SDPNet	SDPNet: A Deep Network for Pan-Sharpening With Enhanced Information Representation	Paper	Code	TGRS	CNN	有监督	2021
SIPSA-Net	SIPSA-Net: Shift-Invariant Pan Sharpening with Moving Object Alignment for Satellite Imagery	Paper	Code	CVPR	CNN	有监督	2021
SRPPNN	Super-resolution-guided progressive pansharpening based on a deep convolutional neural network	Paper	Code	TGRS	CNN	有监督	2021
PSGAN	PSGAN: A generative adversarial network for remote sensing image pan-sharpening	Paper	Code	TGRS	GAN	有监督	2021
MDCNN	MDCNN: multispectral pansharpening based on a multiscale dilated convolutional neural network	Paper		JRS	CNN	有监督	2021
LDP-Net	LDP-Net: An Unsupervised Pansharpening Network Based on Learnable Degradation Processes	Paper	Code	Arxiv	CNN	无监督	2021
DIGAN	Pansharpening approach via two-stream detail injection based on relativistic generative adversarial networks	Paper		ESA	GAN	有监督	2022
DPFN	A Dual-Path Fusion Network for Pan-Sharpening	Paper	Code	TGRS	CNN	有监督	2022
MSGAN	An Unsupervised Multi-scale Generative Adversarial Network for Remote Sensing Image Pan-Sharpening	Paper		ICMM	GAN	无监督	2022
UCGAN	Unsupervised Cycle-Consistent Generative Adversarial Networks for Pan Sharpening	Paper	Code	TGRS	GAN	无监督	2022
P2Sharpen	P2Sharpen: A progressive pansharpening network with deep spectral transformation	Paper	Code	INFFus	CNN	有监督	2023

通用图像融合框架(General Image Fusion Framerwork)

方法	标题	论文	代码	发表期刊或会议	基础框架	监督范式	年份
IFCNN	IFCNN: A general image fusion framework based on convolutional neural network	Paper	Code	InFus	CNN	有监督	2020
FusionDN	FusionDN: A Unified Densely Connected Network for Image Fusion	Paper	Code	AAAI	CNN	无监督	2020
PMGI	Rethinking the Image Fusion: A Fast Unified Image Fusion Network based on Proportional Maintenance of Gradient and Intensity	Paper	Code	AAAI	CNN	无监督	2020
CU-Net	Deep Convolutional Neural Network for Multi-Modal Image Restoration and Fusion	Paper	Code	TPAMI	CNN	有监督	2021
SDNet	SDNet: A Versatile Squeeze-and-Decomposition Network for Real-Time Image Fusion	Paper	Code	IJCV	CNN	无监督	2021
DIF-Net	Unsupervised Deep Image Fusion With Structure Tensor Representations	Paper	Code	TIP	CNN	无监督	2021
IFSepR	IFSepR: A general framework for image fusion based on separate representation learning	Paper		TMM	AE	自监督	2021
MTOE	Multiple Task-Oriented Encoders for Unified Image Fusion	Paper		ICME	CNN	无监督	2021
U2Fusion	U2Fusion: A Unified Unsupervised Image Fusion Network	Paper	Code	TPAMI	CNN	无监督	2022
SwinFusion	SwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin Transformer	Paper	Code	JAS	Transformer	无监督	2022
DeFusion	Fusion from Decomposition: A Self-Supervised Decomposition Approach for Image Fusion	Paper	Code	ECCV	CNN	无监督	2022
UIFGAN	UIFGAN: An unsupervised continual-learning generative adversarial network for unified image fusion	Paper	Code	InFus	GAN	无监督	2023

综述(Survey)

标题	论文	代码	发表期刊或会议	年份
A review of remote sensing image fusion methods	Paper		InFus	2016
Pixel-level image fusion: A survey of the state of the art	Paper		InFus	2017
Deep learning for pixel-level image fusion: Recent advances and future prospects	Paper		InFus	2018
Infrared and visible image fusion methods and applications: A survey	Paper		InFus	2019
Multi-focu image fusion: A Survey of the state of the art	Paper		InFus	2020
Image fusion meets deep learning: A survey and perspective	Paper		InFus	2021
Deep Learning-based Multi-focus Image Fusion: A Survey and A Comparative Study	Paper	Code	TPAMI	2021
Benchmarking and comparing multi-exposure image fusion algorithms	Paper	Code	InFus	2021
Current advances and future perspectives of image fusion: A comprehensive review	Paper		InFus	2023

数据集(Dataset)

融合场景	数据集	下载链接
红外和可见光图像融合	TNO	https://figshare.com/articles/dataset/TNO_Image_Fusion_Dataset/1008029
	INO	https://www.ino.ca/en/technologies/video-analytics-dataset/videos/
	RoadScene	https://github.com/hanna-xu/RoadScene
	MSRS	https://github.com/Linfeng-Tang/MSRS
	LLVIP	https://bupt-ai-cz.github.io/LLVIP/
	M3FD	https://github.com/JinyuanLiu-CV/TarDAL

医学图像融合	Harvard	http://www.med.harvard.edu/AANLIB/home.html

多曝光图像融合	MEF	https://github.com/csjcai/SICE
多曝光图像融合	MEFB	https://github.com/xingchenzhang/MEFB

多聚焦图像融合	Lytro	https://mansournejati.ece.iut.ac.ir/content/lytro-multi-focus-dataset
	MFI-WHU	https://github.com/HaoZhang1018/MFI-WHU
	MFFW	https://www.semanticscholar.org/paper/MFFW%3A-A-new-dataset-for-multi-focus-image-fusion-Xu-Wei/4c0658f338849284ee4251a69b3c323908e62b45

全色图像锐化	GaoFen	https://directory.eoportal.org/web/eoportal/satellite-missions/g
	WorldView	https://worldview.earthdata.nasa.gov/
	GeoEye	https://earth.esa.int/eogateway/missions/geoeye-1
	QuickBird	https://www.satimagingcorp.com/satellite-sensors/quickbird/

评估指标(Evaluation Metric)

通用评估指标(General evaluation metric)

通用评估指标位于：https://github.com/Linfeng-Tang/Image-Fusion/tree/main/General%20Evaluation%20Metric or https://github.com/Linfeng-Tang/Evaluation-for-Image-Fusion