• Login
    View Item 
    •   YODA Home
    • CSEM Archive
    • Research Publications
    • View Item
    •   YODA Home
    • CSEM Archive
    • Research Publications
    • View Item
    JavaScript is disabled for your browser. Some features of this site may not work without it.

    Generative Pre-Trained Transformer for Cardiac Abnormality Detection

    Thumbnail
    Author
    Gaudilliere, Pierre Louis; Sigurthorsdottir, Halla; Aguet, Clémentine; Van Zaen, Jérôme; Lemay, Mathieu; Delgado-Gonzalo, Ricard
    Metadata
    Show full item record
    Abstract
    ECG heartbeat classi?cation plays a vital role in diagnosis of cardiac arrhythmia. The goal of the Physionet/CinC 2021 challenge was to accurately classify clinical diagnosis based on 12, 6, 4, 3 or 2-lead ECG recordings in order to aid doctors in the diagnoses of different heart conditions. Transformers have had great success in the ?eld of natural language processing in the past years. Our team, CinCSEM, proposes to draw the parallel between text and periodic time series signals by viewing the repeated period as “words” and the whole signal as a sequence of such words. In this way, the attention mechanisms of the transformers can be applied to periodic time series signals. In our implementation, we follow the Transformer Encoder architecture, which combines several encoder layers followed by a dense layer with linear or sigmoid activation for generative pre-training or classi?cation, respectively. The use case presented here is multi-label classi?cation of heartbeat abnormalities of ECG recordings shared by the challenge. Our best entry, not exceeding the challenge’s hardware limitations, achieved a score of 0.12, 0.07, 0.10, 0.10 and 0.07 on 12lead, 6-lead, 4-lead, 3-lead and 2-lead test set respectively. Unfortunately, our team was unable to be ranked because of a missing pre-print.
    Publication Reference
    CinC 2021, Brno (CZ)
    Year
    2021-09-13
    URI
    https://yoda.csem.ch/handle/20.500.12839/527
    Collections
    • Research Publications

    Browse

    All of YODACommunities & CollectionsBy Issue DateAuthorsTitlesResearch AreasBusiness UnitsThis CollectionBy Issue DateAuthorsTitlesResearch AreasBusiness Units

    My Account

    Login

    DSpace software copyright © 2002-2022  DuraSpace
    Contact Us | Send Feedback
    DSpace Express is a service operated by 
    Atmire NV