Multimodal learning

Modern medicine is rapidly moving towards a data-driven paradigm based on comprehensive multimodal health assessments. Integrated analysis of data from different modalities has the potential of uncovering novel biomarkers and disease signatures.

14p vibransone 28-03-2024 2 2   Download

Genotypes are strongly associated with disease phenotypes, particularly in brain disorders. However, the molecular and cellular mechanisms behind this association remain elusive. With emerging multimodal data for these mechanisms, machine learning methods can be applied for phenotype prediction at different scales, but due to the black-box nature of machine learning, integrating these modalities and interpreting biological mechanisms can be challenging.

19p vicwell 29-02-2024 4 2   Download

Identifying pathogenic variants from the vast majority of nucleotide variation remains a challenge. We present a method named Multimodal Annotation Generated Pathogenic Impact Evaluator (MAGPIE) that predicts the pathogenicity of multi-type variants.

19p vicwell 29-02-2024 6 2   Download

Ebook "Machine learning in computer vision" includes content: Introduction, probabilistic classifiers, generalization bounds, semi supervised learning, maximum likelihood minimum entropy hmm, margin distribution optimization, learning the structure of bayesian network classifiers, office activity recognition, multimodal event detection, facial expression recognition, bayesian network classifiers for face detection.

249p haojiubujain07 20-09-2023 4 3   Download

The participants in the study also highly perceived the positive effects of multimodal texts on their English language learning. Finally, some implications were drawn from the findings so as to enhance the quality of culture and communication teaching and learning at the upper secondary level.

16p viharry 15-12-2022 12 7   Download

In recent years, the task of Visual Question Answering (VQA) has evolved into a very attractive research field. Normally, this task requires a simultaneous understanding of both the visual content of the image and the textual content of the question.

7p visherylsandberg 18-05-2022 7 2   Download

This study, which focuses on vocabulary teaching methods, is going to investigate the application of multimodality to the vocabulary learning of students from the perspectives of using images in some communicative activities to enhance students‟ vocabulary retention. The major aim of the research is to investigate whether the use of images in vocabulary teaching can help improve students‟ vocabulary retention. The participants in the study are students at Hanoi Architectural University.

86p closefriend09 16-11-2021 25 5   Download

In this paper, we propose COMMODAR, a machine learning-based literature mining framework for context-specific molecular relations using multimodal representations.

8p vikentucky2711 24-11-2020 10 1   Download

RNAs play key roles in cells through the interactions with proteins known as the RNA-binding proteins (RBP) and their binding motifs enable crucial understanding of the post-transcriptional regulation of RNAs. How the RBPs correctly recognize the target RNAs and why they bind specific positions is still far from clear.

14p vioklahoma2711 19-11-2020 9 1   Download

Recognition is an essential function of human beings. Humans easily recognize a person using various inputs such as voice, face, or gesture. In this study, we mainly focus on DL model with multi-modality which has many benefits including noise reduction. We used ResNet-50 for extracting features from dataset with 2D data.

11p vicolorado2711 22-10-2020 14 0   Download

In this paper, we present a model-based learning for brain tumour segmentation from multimodal MRI protocols. The model uses U-Net-based fully convolutional networks to extract features from a multimodal MRI training dataset and then applies them to Extremely randomized trees (ExtraTrees) classifier for segmenting the abnormal tissues associated with brain tumour. The morphological filters are then utilized to remove the misclassified labels. Our method was evaluated on the Brain Tumour Segmentation Challenge 2013 (BRATS 2013) dataset, achieving the Dice metric of 0.85, 0.81 and 0.

7p caygaocaolon1 13-11-2019 12 0   Download

The present panorama of communication features the co-employment of language and other semiotic resources. This paper addresses this fledging field, multimodal discourse analysis, by investigating a genre targeted at children. Specifically, it studies how meanings in comics for children are constructed both verbally and visually. The data for the study is one comic - Little Red Riding Hood, which is presented via colored images and verbal texts in English.

12p quenchua1 11-11-2019 29 1   Download

Given recent attention to emotion regulation (ER) as an important factor in personal well-being and effective social communication, there is a need for detection mechanisms that accurately capture ER and facilitate adaptive responding (Calvo & D’Mello, 2010). Current approaches to determining ER are mainly limited to self-report data such as questionnaires, inventories and interviews (e.g., Davis, Griffith, Thiel, & Connelly, 2015).

30p kequaidan1 05-11-2019 30 2   Download

We demonstrate a multimodal dialogue system using reinforcement learning for in-car scenarios, developed at Edinburgh University and Cambridge University for the TALK project1. This prototype is the first “Information State Update” (ISU) dialogue system to exhibit reinforcement learning of dialogue strategies, and also has a fragmentary clarification feature. This paper describes the main components and functionality of the system, as well as the purposes and future use of the system, and surveys the research issues involved in its construction. ...

4p bunthai_1 06-05-2013 42 2   Download

Holographic Storage. Stores data on a holographic (3-dimensional) image by passing light through light-sensitive crystals that retain the light patterns. It will have multiple thousands of times more memory capacity and no mechanical movements. Large blocks of data can be written or read with a single read or write command as opposed to today’s 2-dimensional storages devices that read and write data one bit at a time.

24p thamgiacongdong 02-05-2013 42 7   Download

Motivated by psycholinguistic findings that eye gaze is tightly linked to human language production, we developed an unsupervised approach based on translation models to automatically learn the mappings between words and objects on a graphic display during human machine conversation. The experimental results indicate that user eye gaze can provide useful information to establish such mappings, which have important implications in automatically acquiring and interpreting user vocabularies for conversational systems. ...

8p hongvang_1 16-04-2013 44 1   Download

We investigate the use of machine learning in combination with feature engineering techniques to explore human multimodal clarification strategies and the use of those strategies for dialogue systems. We learn from data collected in a Wizardof-Oz study where different wizards could decide whether to ask a clarification request in a multimodal manner or else use speech alone. We show that there is a uniform strategy across wizards which is based on multiple features in the context. These are generic runtime features which can be implemented in dialogue systems. ...

8p hongvang_1 16-04-2013 43 2   Download

We address two problems in the field of automatic optimization of dialogue strategies: learning effective dialogue strategies when no initial data or system exists, and evaluating the result with real users. We use Reinforcement Learning (RL) to learn multimodal dialogue strategies by interaction with a simulated environment which is “bootstrapped” from small amounts of Wizard-of-Oz (WOZ) data.

9p hongphan_1 15-04-2013 49 2   Download

The above-mentioned skills, however, are necessary for the effective implementation of health promotion programs in schools. This means that if the health promotion programs are to be successful, its participants must not only carry out the programme itself, but also learn new general skills in using effective strategies and programme management technologies. We assume that the situation will change in the future, because a concept of the national educational development programme (the so-called White Book) has been prepared since the second half of 1999.

36p chiecxedien 02-01-2013 81 2   Download

Securities regulators oversee Canada’s capital markets and the advisers who sell and manage securities traded in those markets. We strive to protect investors from unfair, improper and fraudulent practices while fostering a fair and efficient marketplace. You can contact your local securities regulator listed on page 20 to check the registration of an individual or firm, and to find out if they have been involved in any disciplinary actions.

24p quaivatdo 18-11-2012 46 4   Download