Molecular representation learning (MRL) is essential in certain applications including drug discovery and life science. Despite advancements in multiview and multimodal learning in MRL, existing models have explored only a limited range of perspectives, and the fusion of different views and modalities in MRL remains underexplored. Besides, obtaining the geometric conformer of molecules is not feasible

Pan-sharpening involves integrating information from low-resolution multi-spectral and high-resolution panchromatic images to generate high-resolution multi-spectral counterparts. While recent advancements in the state space model, particularly the efficient long-range dependency modeling achieved by Mamba, have revolutionized computer vision community, its untapped potential in pan-sharpening motivates

Timely and accurate diagnosis of bearing faults can effectively reduce the chance of accidents in equipment. However, deep learning methods are mostly completely dependent on data and lack interpretability. It is difficult to deal with the differences between real-time data and training data under changing working conditions and noisy environments. In this study, we proposed M-IPISincNet, an explainability

Personalized federated learning (PFL) addresses the significant challenge of non-independent and identically distributed (non-IID) data across clients in federated learning (FL). Our proposed framework, “FairDPFL-SCS: Fair Dynamic Personalized Federated Learning with Strategic Client Selection”, marks a notable advancement in this domain. By integrating dynamic learning rate adjustments and a strategic

Concerns related to data privacy, security, and ethical considerations become more prominent as data volumes continue to grow. In contrast to centralized setups, where all data is accessible at a single location, model-based clustering approaches can be successfully employed in federated settings. However, this approach to clustering in federated settings is still relatively unexplored and requires

In a complex environment, a multi-sensor fusion algorithm can compensate for the limitations of a single sensor’s performance. In a distributed fusion algorithm, sensors need to transmit local estimates to a central coordinate system, and the existence of coordinate transformation uncertainty can undermine the performance of data transmission. Therefore, this paper proposes a multi-sensor distributed

In the era of big data and artificial intelligence, healthcare data fusion analysis has become difficult because of the large amounts and different types of sources involved. Traditional methods are ineffective at processing and examination procedures for such complex multi-sensors of hyperscale healthcare data. To address this issue, we propose a novel large model-driven approach for hyperscale healthcare

Incomplete multi-view clustering (IMVC) aims to address the clustering problem of multi-view data with partially missing samples and has received widespread attention in recent years. Most existing IMVC methods still have the following issues that require to be further addressed. They focus solely on the first-order correlation information among samples, neglecting the more intricate high-order connections

Missing multi-label learning is to address the problem of missing labels in multi-label datasets for multi-label classification tasks. Notably, the complex dependencies that typically exist between labels make accurate classification particularly challenging in the presence of missing labels. Some existing missing multi-label classification models often utilize feature selection to effectively recognize

Shared Autonomous Mobility on Demand (SAMoD) is considered one of the most efficient modes of transportation for future cities and has thus gained significant attention. However, it may attract the ridership of public transportation (PT) systems, leading to negative externalities such as traffic congestion and environmental pollution. Greater social benefits can only be realized by seamlessly integrating

Multimodal Sentiment Analysis (MSA) utilizes complementary multimodal features to predict sentiment polarity, which mainly involves language, vision, and audio modalities. Existing multimodal fusion methods primarily consider the complementarity of different modalities, while neglecting the ambiguity caused by conflicts between modalities (i.e. the text modality predicts positive sentiment while the

There exists many large-scale multi-source data, ranging from genetic information to medical records, and military intelligence. The inherent intricacies and uncertainties embedded within these data sources pose significant challenges to the process of information fusion. Owing to its exceptional capacity to represent data uncertainty, Dempster-Shafer (D-S) evidence theory has emerged as a widely utilized

Probabilistic linguistic term sets perform a particularly active role in the field of decision-making, particularly regarding decision-makers (DMs) who are inclined to convey evaluative information through natural linguistic variables. To effectively improve the current dilemma of multi-attribute group decision-making (MAGDM), this article put forward a new probabilistic linguistic MAGDM method with

Neural Radiance Field (NeRF) technology demonstrates immense potential in novel viewpoint synthesis tasks due to its physics-based volumetric rendering process, which is particularly promising in underwater scenes. However, existing underwater NeRF methods face challenges in handling light attenuation caused by the water medium and the lack of real Ground Truth (GT) supervision. To address these issues

In the last few years, Artificial Intelligence (AI) systems have become increasingly widespread. Unfortunately, these systems can share many biases with human decision-making, including demographic biases. Often, these biases can be traced back to the data used for training, where large uncurated datasets have become the norm. Despite our awareness of these biases, we still lack general tools to detect

Affective computing stands at the forefront of artificial intelligence (AI), seeking to imbue machines with the ability to comprehend and respond to human emotions. Central to this field is emotion recognition, which endeavors to identify and interpret human emotional states from different modalities, such as speech, facial images, text, and physiological signals. In recent years, important progress

Deep learning-based medical image segmentation methods have demonstrated significant clinical applications. However, training these methods on small-sample vascular datasets remains challenging due to the scarcity of labeled data and severe category imbalance. To address this, this paper proposes Mid-Net, which fully exploits the often-overlooked feature representation potential of the middle-layer

Accurate segmentation of polyps in the colorectal region is crucial for medical diagnosis and the localization of polyp areas. However, challenges arise from blurred boundaries due to the similarity between polyp edges and surrounding tissues, variable polyp morphology, and speckle noise. To address these challenges, we propose a Hybrid Multi-Frequency Perception Gated Selection Network (Polyp-Mamba)

To enhance the adaptability and performance of Convolutional Neural Networks (CNN), we present an adaptable mechanism called Alignable Kernel (AliK) unit, which dynamically adjusts the receptive field (RF) dimensions of a model in response to varying stimuli. The branches of AliK unit are integrated through a novel align transformation softmax attention, incorporating prior knowledge through rank ordering

The training of deep models relies on appropriate regularization from a copious amount of labeled data. And yet, obtaining a large and well-annotated dataset is costly. Thus, supervised domain adaptation (SDA) becomes attractive, especially when it aims to regularize these networks for a data-scarce target domain by exploiting an available data-rich source domain. Different from previous methods focusing

This survey presents an in-depth review of the transformative role of Natural Language Processing (NLP) in finance, highlighting its impact on ten major financial applications: (1) financial sentiment analysis, (2) financial narrative processing, (3) financial forecasting, (4) portfolio management, (5) question answering, virtual assistant and chatbot, (6) risk management, (7) regulatory compliance

3D segmentation is a fundamental and challenging problem in computer vision with applications in autonomous driving and robotics. It has received significant attention from the computer vision, graphics and machine learning communities. Conventional methods for 3D segmentation, based on hand-crafted features and machine learning classifiers, lack generalization ability. Driven by their success in 2D

In recent years, multisensor fusion for state estimation has gained considerable attention. The effectiveness of the optimal fusion estimation method heavily relies on the correlation among sensor measurement noises. To enhance estimate fusion performance by mining unknown correlation in the data, this paper introduces a novel multisensor fusion approach using an information filtering neural network

3D scene understanding often faces the problems of insufficient detail capture and poor adaptability to multi-view changes. To this end, we proposed a NeRF-based 3D scene understanding model DSEM-NeRF, which effectively improves the reconstruction quality of complex scenes through multimodal feature fusion and global–local attention mechanism. DSEM-NeRF extracts multimodal features such as color, depth

Contemporary audio–visual speech separation (AVSS) models typically use encoders that merge audio and visual representations by concatenating them at a specific layer. This approach assumes that both modalities progress at the same pace and that information is adequately encoded at the chosen fusion layer. However, this assumption is often flawed due to inherent differences between the audio and visual

The Hyperbolic space has garnered attention for its unique properties and efficient representation of hierarchical structures. Recent studies have explored hyperbolic alternatives to hyperplane-based classifiers, such as logistic regression and support vector machines. Hyperbolic methods have even been fused into random forests by constructing data splits with horosphere, which proved effective for

Recognizing the coreference relationship between different event mentions in the text (i.e., event coreference resolution) is an important task in natural language processing. It helps to understand the association between various events in the text, and plays an important role in information extraction, question answering systems, and reading comprehension. Existing research has made progress in improving

The misuse of social platforms and the difficulty in regulating post contents have culminated in a surge of negative sentiments, sarcasms, and the rampant spread of fake news. In response, Multimodal sentiment analysis, sarcasm detection and fake news detection based on image and text have attracted considerable attention recently. Due to that these areas share semantic and sentiment features and confront

Code Language Models (codeLMs) and Graph Neural Networks (GNNs) are widely used in code vulnerability detection. However, a critical yet often overlooked issue is that GNNs primarily rely on aggregating information from adjacent nodes, limiting structural information transfer to single-layer updates. In code graphs, nodes and relationships typically require cross-layer information propagation to fully

Consensus-reaching strategy is crucial in large-scale group decision-making (LSGDM) as it serves as an effective approach to reducing group conflicts. Meanwhile, the common social network relationships in large groups can affect information exchange, thereby influencing the consensus-reaching process (CRP) and decision results. Therefore, how to leverage social network information in LSGDM to obtain

With the ever-growing complexity of models in the field of remote sensing (RS), there is an increasing demand for solutions that balance model accuracy with computational efficiency. Knowledge distillation (KD) has emerged as a powerful tool to meet this need, enabling the transfer of knowledge from large, complex models to smaller, more efficient ones without significant loss in performance. This

In multi-view representation learning (MVRL), the challenge of category uncertainty is significant. Existing methods excel at deriving shared representations across multiple views, but often neglect the uncertainty associated with cluster assignments from each view, thereby leading to increased ambiguity in the category determination. Additionally, methods like kernel-based or neural network-based

Due to the high cost of annotation or the rarity of some diseases, medical image segmentation is often limited by data scarcity and the resulting overfitting problem. Self-supervised learning and semi-supervised learning can mitigate the data scarcity challenge to some extent. However, both of these paradigms are complex and require either hand-crafted pretexts or well-defined pseudo-labels. In contrast

High-quality shipping is one of the effective ways for sustainable cities in inland river basins to improve transportation efficiency and reduce energy consumption. Currently, the biggest challenge faced by shipping is the high empty-ship rate, which makes it impossible to directly apply machine learning methods due to the cold-start problem. Although some researchers have tried to utilize deep reinforcement

The construction of zero-waste (ZW) cities receives increasing attention from the Chinese government. The evaluation is essential to make policy variations according to the actual situation in each place. Previous assessments of ZW cities have primarily relied on historical data, which fails to account for the subjective preferences of various stakeholders. For example, it is challenging to capture

Imaging genomics is poised to revolutionize clinical practice by providing deep insights into the genetic underpinnings of disease, enabling early detection, and facilitating personalized treatment strategies. The field has seen remarkable advancements, with significant momentum fueled by cutting-edge imaging techniques, sophisticated data-driven fusion methods, and extensive large cohort datasets

Multi-view learning seeks to leverage the advantages of various views to complement each other and make full use of the latent information in the data. Nevertheless, effectively exploring and utilizing common and complementary information across diverse views remains challenging. In this paper, we propose two multi-view classifiers: multi-view support vector machine via L0/1 soft-margin loss (MvL0/1-SVM)

The emerging proportion of renewable energy resources penetration and the rapid popularity of Electric Vehicles (EVs) have promoted the development of the Internet of Electric Vehicles (IoEV), which enables seamless EV’ information collection and energy delivery by leveraging wireless power transfer. However, vulnerabilities in internet infrastructure and the self-interested behavior of EVs pose significant

Multi-source data fusion is essential for building smart cities by providing a comprehensive and holistic understanding of urban environments. Specifically, smart city-oriented knowledge graphs (KGs) require supplementary information from other open sources to increase their completeness, thus better supporting downstream tasks for smart cities. Nevertheless, existing open knowledge graph completion

Rotating machinery forms the critical backbone of infrastructure in a sustainable city, with bearings playing a pivotal role as key mechanical transmission components. Therefore, the health status of these bearings directly influences the safe operation of the infrastructure. Accurate and reliable diagnosis of defects in these components minimizes downtime, reduces maintenance costs, and prevents major

In the field of cross-view image geolocation, traditional convolutional neural network (CNN)-based learning models generate unsatisfactory fusion performance due to their inability to model global correlations. The Transformer-based fusion methods can well compensate for the above problems, however, the Transformer has quadratic computational complexity and huge GPU memory consumption. The recent Mamba

Solving the long-tailed visual recognition with deep convolutional neural networks is still a challenging task. As a mainstream method, multi-experts models achieve SOTA accuracy for tackling this problem, but the uncertainty in network learning and the complexity in fusion inference constrain the performance and practicality of the multi-experts models. To remedy this, we propose a novel dynamic collaborative

Human activity recognition (HAR) is an emerging area of study and research field that explores the development of automated systems to identify and categorize human activities using data collected from various sensors. In the field of Human Activity Recognition (HAR), binary sensors offer a distinct approach by providing simpler on/off readings to indicate the presence of events such as door openings

Humans can continually solve new problems with a few examples and enhance their learned knowledge by incorporating new ones. Few-shot lifelong learning (FSLL) has been presented to mimic human learning ability. However, they overlook the significance of cross-domain knowledge and little effort has been made to investigate it. In this paper, we explore the effects of cross-domain knowledge in FSLL and

Recent advancements in state-of-the-art technologies, including Artificial Intelligence (AI), Internet of Things (IoT), and cloud computing, have led to the emergence of an innovative technology known as digital twins (DTs). A digital twin is a virtual replica of the physical entity, with data connections in between. This technology has proven highly effective in several industries by improving decision-making

Sustainability commonly refers to entities, such as individuals, companies, and institutions, having a non-detrimental (or even positive) impact on the environment, society, and the economy. With sustainability becoming a synonym of acceptable and legitimate behaviour, it is being increasingly demanded and regulated. Several frameworks and standards have been proposed to measure the sustainability

In the realm of information fusion, clustering stands out as a common subject and is extensively applied across various fields. Evidential clustering, an increasingly popular method in the soft clustering family, derives its strength from the theory of belief functions, which enables it to effectively characterize the uncertainty and imprecision of data distributions. This survey provides a comprehensive

A micro-expression is a fleeting, delicate and localized facial gesture. It can expose the true feelings that someone is trying to hide and is seen to be a crucial indicator for spotting lies. Because of its possible applications in a variety of sectors, micro-expression research has garnered a lot of attention. The accuracy of micro-expression recognition still needs to be improved, though, because

Deep learning (DL) has been widely used in various fields. However, its black-box nature limits people's understanding and trust in its decision-making process. Therefore, it becomes crucial to research the DL interpretability, which can elucidate the model's decision-making processes and behaviors. This review provides an overview of the current status of interpretability research. First, the DL's

Small inaccuracies in the system components or artificial intelligence (AI) models for medical imaging could have significant consequences leading to life hazards. To mitigate those risks, one must consider the precision of the image analysis outcomes (e.g., image segmentation), along with the confidence in the underlying model predictions. U-shaped architectures, based on the convolutional encoder–decoder

Acute ischemic stroke (AIS) is a common brain disease worldwide, and diagnosing AIS requires effectively utilizing information from multiple Computed Tomography Perfusion (CTP) maps. As far as we know, most methods independently process each CTP map or fail to fully utilize medical prior information when integrating the information from CTP maps. Considering the characteristics of AIS lesions, we propose

Multimodal sentiment analysis (MSA) involves interpreting sentiment using various sensory data modalities. Traditional MSA models often overlook causality between modalities, resulting in spurious correlations and ineffective cross-modal attention. To address these limitations, we propose the Attention-based Causality-Aware Fusion (AtCAF) network from a causal perspective. To capture a causality-aware

Image color aesthetics assessment (ICAA) aims to assess color aesthetics based on human perception, which is crucial for various applications such as imaging measurement and image analysis. The ceiling of previous methods is constrained to a holistic evaluation approach, which hinders their ability to offer explainability from multiple perspectives. Moreover, existing ICAA datasets often lack multi-attribute

Major Depressive Disorder (MDD) is a serious and highly heterogeneous psychological disorder. According to the network hypothesis, depression originates from abnormal neural network information processing, typically resulting in aberrant changes in the topological structure of the brain’s functional network. Recent evidence further reveals that depression involves dynamic changes related to both within-

Image colorization estimates RGB colors for grayscale images or video frames to improve their aesthetic and perceptual quality. Over the last decade, deep learning techniques for image colorization have significantly progressed, necessitating a systematic survey and benchmarking of these techniques. This article presents a comprehensive survey of recent state-of-the-art deep learning-based image colorization

Multi-view learning (MVL) is a promising data fusion technique based on the principles of consensus and complementarity. Despite significant advancements in this field, several challenges persist. First, scalability remains an issue, as many existing approaches are limited to two-view scenarios, making them difficult to extend to more complex multi-view settings. Second, implementing consensus principles

A Bayes filter is a widely used estimation algorithm, but it has inherent limitations. Performance can degrade when the dynamics are highly nonlinear or when the probability distribution of the state is unknown. To mitigate these issues, machine learning (ML) techniques have been incorporated into many Bayes filters, due to their advantage of being able to map between the input and the output without

Biometric authentication has garnered significant attention as a secure and efficient method of identity verification. Among the various modalities, hand vein biometrics, including finger vein, palm vein, and dorsal hand vein recognition, offer unique advantages due to their high accuracy, low susceptibility to forgery, and non-intrusiveness. The vein patterns within the hand are highly complex and

With the evolution of human–robot collaboration in advanced manufacturing, multisensor integration has increasingly become a critical component for ensuring safety during human–robot interactions. Given the disparities in range scales, densities, and arrangement patterns among multisensor data, such as that from depth cameras and LiDAR, accurately fusing information from multiple sources has emerged