Bio
-
Jyh-Shing Roger Jang received PhD from EECS Department at UC Berkeley, where he worked with Lotfi Zadeh, the father of fuzzy logic, on fuzzy logic and neural networks. As of Feb 2023, Google Scholar shows that Dr. Jang’s seminal 1993 paper on ANFIS has been cited more than 20,000 times. After earning his PhD, he joined MathWorks and coauthored the Fuzzy Logic Toolbox (for MATLAB). Since then, he has developed a keen interest in implementing industrial software for machine learning. From 1995 to 2012, he was a professor in the CS Dept. of National Tsing Hua Univ., Taiwan, and since August 2012, he has been a professor in the CSIE Dept. of National Taiwan Univ. (NTU), Taiwan. He published a book entitled "Neuro-Fuzzy and Soft Computing" by Prentice Hall. He also maintains toolboxes for machine learning and speech/audio processing. He was the general chair of ISMIR (International Society for Music Information Retrieval) Conference at Taipei, 2014 and was a general co-chair of ISMIR Conference at Suzhou, 2017. He was the IT director for NTU Hospital from 2017-2019, and the director for FinTech Research Center at NTU from 2018-2022. He is currently the CTO of E.Sun Financial Holding Company, focusing on implementing AI services for comprehensive digital transformation. His research interests include machine learning in practice, with applications to fintech, speech recognition/assessment/synthesis, natural language processing, medical/healthcare data analytics, computer vision, and music analysis/retrieval.
-
個人簡介：張智星於1984取得台灣大學電機系學士、1992年取得美國加州大學柏克萊分校電機電腦博士，博士論文為類神經網路與模糊邏輯之建模與應用。1993~1995任職於美國麻州 MathWorks 公司，負責開發與 MATLAB 合用的Fuzzy Logic Toolbox。1995年起回台任教於清華大學資訊系，2012年轉任台大資訊系。2017-2019年擔任台大醫院資訊室主任，2018年起擔任台大金融科技研究中心首任主任，2020年借調到玉山金控擔任科技長。張教授擅長於跨域跨界的合作，扮演科技人與金融人交流激盪的橋樑，並媒合學術界與產業界的資源，為銀行注入更多的科技元素，打造銀行裡的科技業。專長在於人工智慧與機器學習之各項應用，包含語音辨識與評分、音樂分析與檢索、文件分類與對話機器人、基於影像辨識之運動分析、醫療數據與金融資料分析等領域。
Contact Info
- Name: Jyh-Shing Roger Jang (張智星)
- Gender & DOB: Male, 1962/03/31
- Affiliation:
- Professor at Department of CSIE (Computer Science and Information Engineering), National Taiwan University, Taipei, Taiwan
- CTO (Chief Technology Officer) at E.SUN Bank (ranked 1st in Taiwan’s banking industry in "The World’s Best Banks 2021” by Forbes) , Taipei, Taiwan
- E-mail: jang@mirlab.org
- URL: http://mirlab.org/jang
- Phone: +886-2-33664888 ext 509 (office), +886-2-23628167 (fax), +886-953-154045 (mobile)
Research Interests
- Healthcare and medical data analytics
- Data analytics in fintech
- Document classification and natural language processing
- Speech recognition, scoring, and synthesis
- Music analysis and retrieval
- Image recognition
- Machine learning, pattern recognition, neural networks and fuzzy logic
Education
- Ph.D. in Electrical Engineering and Computer Sciences, University of California at Berkeley, 1992. (Advisor: Prof. Lotfi Zadeh)
- B.S. in Electrical Engineering, June 1984, National Taiwan University, Taipei, Taiwan.
Experiences
- Aug. 2020 ~ now: CTO, E.Sun Financial Holding Company
- Aug. 2012 ~ now: Professor, CSIE Department, National Taiwan University, Taiwan
- May 2018 ~ Jul. 2022: Director, Fintech Research Center, National Taiwan University, Taiwan
- Aug. 2017 ~ Jul. 2019: Director, IT Office, National Taiwan University Hospital, Taiwan
- Aug. 2014 ~ Jul. 2017: Associate Chairman of CSIE Department, National Taiwan University, Taiwan
- Aug. 2009 ~ Jul. 2012: Professor, CS Department, Tsing Hua University, Taiwan
- Feb. 2006 ~ Aug. 2009: Associate Professor, CS Department, Tsing Hua University, Taiwan
- Feb. 2004 ~ Jan. 2006: CTO, CWeb Technology, Taipei, Taiwan
- Aug. 2001 ~ Jan. 2004: Associate Professor, CS Department, Tsing Hua University, Taiwan
- Aug. 1995 ~ Aug. 2001: Assistant Professor, CS Department, Tsing Hua University, Taiwan
- Sept. 1993 ~ Aug. 1995: Software engineer, The MathWorks Inc., Natick, Massachusetts
- Nov. 1992 ~ Aug. 1993: Research associate, EECS Department, University of California at Berkeley
Recent Professional Activities
- General Co-Chair for 18th ISMIR (International Society for Music Information Retrieval Conference), Suzhou, China, 2017
- General Chair for 15th ISMIR (International Society for Music Information Retrieval Conference), Taipei, Taiwan, 2014
- Invited Lectures/Courses in International Conferences
- "QBSH and AFP as Two Successful Paradigms of Music Information Retrieval": An invited short course given at the 7th Russian Summer School in Information Retrieval (RussIR 2013), Kazan, Russia.
Citation Statistics
- Google Citation Profile On 2023/02/23 (URL)
- Ranked 19 in 29 researchers of China that was listed in top-1000 computer scientist with high h-index in 2018.
- Ranked 6318 (top 3.1%) worldwide in all areas in "Top 2% Most Influential Scientists (Career Impact 1788-2023) in 2023 Stanford University List: Analysing the Contributions of Taiwanese Researchers". (Ranked 14 or top 0.8% in Taiwan in all areas)
Honors and Awards
- 2015: Gold Award of Electro-Acoustic Papers of Merry Inc.（美律電聲論文獎金質獎）
- 2013: Second Prize for IPPR Award of Technical Innovation and Industrial Applications（第一屆IPPR技術創新暨產業應用獎，第二名）
- 2012: Outstanding Teaching Award at College of EECS of Tsing Hua University（清華大學電資院傑出教學獎）
- 2012: Gold Award of Electro-Acoustic Papers of Merry Inc.（美律電聲論文獎金質獎）
- 2010: Bronze Award of Electro-Acoustic Papers of Merry Inc.（美律電聲論文獎銅質獎）
- 2009: Industry Collaboration Award in Tsing Hua University（清華大學產學合作獎）
- 2001: Outstanding Teaching Award in Tsing Hua University（清華大學傑出教學獎）
- 2000: Outstanding Research Award for New Faculty in Tsing Hua University（清華大學新進人員研究獎）
- 1998, 2000, and 2008: Nominated for Outstanding Teaching Award in Tsing Hua University（清華大學傑出教學獎提名）
- 1995, 1996 and 1997: Outstanding Research Award, National Science Council in Taiwan（國科會甲等研究獎）
Recent Publications (since 2015)
- Journal Papers
- Jun-You Wang and Jyh-Shing Roger Jang, "Training a Singing Transcription Model Using Connectionist Temporal Classification Loss and Cross-Entropy Loss", IEEE/ACM Transactions on Audio, Speech, and Language Processing, Vol. 31, PP. 383-396, 2023.
- Shu-I Chiu, Ling-Yun Fan, Chin-Hsien Lin, Ta-Fu Chen, Wee Shin Lim, Jyh-Shing Roger Jang, and Ming-Jang Chiu, "ML-Based Classification of Subjective Cognitive Decline, Mild Cognitive Impairment, and Alzheimer's Dementia Using Neuroimage and Plasma Biomarkers", ACS Chemical Neuroscience, Nov 2022.
- Wee Shin Lim, Shu-I Chiu, Meng-Ciao Wu, Shu-Fen Tsai, Pu-He Wang, Kun-Pei Lin, Yung-Ming Chen, Pei-Ling Peng, Yung-Yaw Chen, Jyh-Shing Roger Jang, and Chin-Hsien Lin, "An Integrated Biometric Voice and Facial Features for Early Detection of Parkinson's disease", npj Parkinson's Disease, No. 145, Vol. 8, Oct 2022.
- Chang-Fu Su, Shu-I Chiu, Jyh-Shing Roger Jang, and Feipei Lai, "Improved Inpatient Deterioration Detection in General Wards by Using Time-series Vital Signs", Scientific Reports, No. 11901, Vol. 12, 2022.
- Kuan-Yu Lin, Cheng-Sheng Liang, Cheng-Che Hsu, Shuei-Liong Lin, Yi-Ting Chen, Fong-Shung Huang, Shang-Lin Wang, Jyh-Shing Jang, and Yen-Wen Lu, "Optoelectronic Online Monitoring System for Hemodialysis and Its Data Analysis", Sensors and Actuators: B. Chemical, Vol. 364, 2022.
- Wee Shin Lim, Heng-Yen Ho, Heng-Chen Ho, Yan-Wu Chen, Chih-Kuo Lee, Pao-Ju Chen, Feipei Lai, Jyh-Shing Roger Jang & Mei-Lan Ko, "Use of Multimodal Dataset in AI for Detecting Glaucoma Based on Fundus Photographs Assessed with OCT: Focus Group Study on High Prevalence of Myopia", BMC Medical Imaging, No. 206, Vol. 22, Nov 2022.
- Ta-Ching Chen, Wee Shin Lim, Victoria Y. Wang, Mei-Lan Ko, Shu-I Chiu, Yu-Shu Huang, Feipei Lai, Chung-May Yang, Fung-Rong Hu, Jyh-Shing Roger Jang and Chang-Hao Yang, "Artificial Intelligence-Assisted Early Detection of Retinitis Pigmentosa — the Most Common Inherited Retinal Degeneration", Journal of Digital Imaging, 2021.
- Cheng-Tse Wu, Ta-Wei Chu, Jyh-Shing Roger Jang, "Current-Visit and Next-Visit Prediction for Fatty Liver Disease With a Large-Scale Dataset: Model Development and Performance Comparison", JMIR Med Informatics, No. 8, Vol. 9, 2021.
- Chin-Hsien Lin, Shu-I Chiu, Ta-Fu Chen, Jyh-Shing Roger Jang, Ming-Jang Chiu, "Classifications of Neurodegenerative Disorders Using a Multiplex Blood Biomarkers-Based Machine Learning Model", International Journal of Molecular Sciences, No. 18, Vol. 21, PP. E6914, Sept 2020.
- Szu-Yu Chou, Jyh-Shing Roger Jang, and Yi-Hsuan Yang, "Fast Tensor Factorization for Large-Scale Context-Aware Recommendation from Implicit Feedback", IEEE Transaction on Big Data, No. 1, Vol. 6, PP. 201-208, 2020.
- Tzu-Chun Yeh and Jyh-Shing Roger Jang, "AutoRhythm: A Music Game with Automatic Hit-Timing Generation and Percussion Identification", IEEE Transaction on Games, No. 3, Vol. 12, PP. 291-301, Aug 2019.
- Zhe-Cheng Fan, Tak-Shing T. Chan, Yi-Hsuan Yang, Jyh-Shing R. Jang, "Backpropagation with N-D Vector-Valued Neurons Using Arbitrary Bilinear Products", Transactions on Neural Networks and Learning Systems (TNNLS), No. 7, Vol. 31, PP. 2638-2652, Sept 2019.
- C. Y. Su, C. Y. Tseng, J.-S. Roger Jang, and T. Visceglia, "A Hierarchical Linguistic Information-based Model of English Prosody: L2 Data Analysis and Implications for Computer-Assisted Language Learning", Computer Speech & Language, Vol. 51, PP. 44-67, 2018.
- Chunta Chen and Jyh-Shing Roger Jang, "An Effective Method for Audio-to-score Alignment Using Onsets and Modified Constant Q Spectra", Multimedia Tools and Applications, 2018.
- F.-W. Liu, S.-T. Ding, E.-C. Lin, Y.-W. Lu and J.-S. R. Jang, "Automated Melting Curve Analysis in Droplet Microfluidics for Single Nucleotide Polymorphisms (SNP) Genotyping", RSC Advances, No. 8, Vol. 7, PP. 4646-4655, The Royal Society of Chemistry, Jan 2017.
- Yi-Fen Liu, Shu-Chuan Tseng, and Jyh-Shing Roger Jang, "Deriving Disyllabic Word Variants from a Chinese Conversational Speech Corpus", Journal of the Acoustical Society of America, No. 1, Vol. 140, PP. 308-321, 2016.
- Yin-Tzu Lin, I-Ting Liu, Jyh-Shing Roger Jang, and Ja-Ling Wu, "Audio Musical Dice Game: A User-preference-aware Medley Generating System", ACM Transactions on Multimedia Computing, Communication and Applications, 2015.
- Liang-Yu Chen, Jyh-Shing Roger Jang, "Automatic Pronunciation Scoring with Score Combination by Learning to Rank and Class-Normalized DP-Based Quantization", IEEE Transactions on Audio, Speech, and Language Processing, No. 11, Vol. 23, PP. 1737-1749, 2015.
- Ting-Yun Wang, Jwo-Luen Pao, Rong-Sen Yang, Jyh-Shing Roger Jang, and Wei-Li Hsu, "The Adaptive Changes in Muscle Coordination Following Lumbar Spinal Fusion", Human Movement Science, Vol. 40, PP. 284-297, 2015.
- Ming-Ju Wu and Jyh-Shing Roger Jang, "Combining Acoustic and Multilevel Visual Features for Music Genre Classification", ACM Transactions on Multimedia Computing Communications and Applications, 2015.
- Jia-Min Ren, Ming-Ju Wu, and Jyh-Shing Roger Jang, "Automatic Music Mood Classification Based on Timbre and Modulation Features", IEEE Trans. On Affective Computing, 2015.
- Ming-Ju Wu, Jyh-Shing Roger Jang, and Jui-Long Chen, "Wafer Map Failure Pattern Recognition and Similarity Ranking for Large-scale Datasets", IEEE Transactions on Semiconductor Manufacturing, 2015.
- Chung-Che Wang and Jyh-Shing Roger Jang, "Improving Query by Singing/Humming by Combining Melody and Lyric Information", IEEE Transactions on Audio, Speech, and Language Processing, 2015.
- Conference Papers
- Henian Li, Lang Lin, Norman Chang, Sreeja Chowdhury, Dylan Mcguire, Bozidar Novakovic, Kazuki Monta, Makoto Nagata, Ying-Shiun Li, Pramod M S, Piin-Chen Yeh, Jyh-Shing Roger Jang, Chengjie Xi, Qiutong Jin, Navid Asadi, and Mark Tehranipoor, "Photon Emission Modeling and Machine-Learning Assisted Pre-Silicon Optical Side-channel Simulation", IEEE International Symposium on Hardware Oriented Security and Trust (HOST), Washington DC, USA, May 2024.
- Xuanjun Chen, Haibin Wu, Chung-Che Wang, Hung-yi Lee, and Jyh-Shing Roger Jang, "Multimodal Transformer Distillation for Audio-Visual Synchronization", International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Seoul, Korea, April 2024.
- Jun-You Wang, Chung-Che Wang, Chon-In Leong, and Jyh-Shing Roger Jang,, "MIR-MLPOP: A Multilingual Pop Music Dataset with Time-Aligned Lyrics and Audio", International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Seoul, Korea, April 2024.
- Qiu-Xia Zhang, Te-Yu Chi, Te-Lun Yang, Yu-Meng Tang, Ta-Lin Chen, and Jyh-Shing Jang, "Category Mapping for Zero-shot Text Classification", ROCLING Conference, Taipei, Taiwan, Oct 2023.
- Yin-Chieh Wang, Wen-Hong Wu, Feng-Yu Kuo, Han-Chun Wu, Te-Yu Chi, Te-Lun Yang, Sheh Chen, and Jyh-Shing Roger Jang, "CrowNER at ROCLING 2023 MultiNER-Health Task: Enhancing NER Task with GPT Paraphrase Augmentation on Sparsely Labeled Data", ROCLING Conference, Taipei, Taiwan, Oct 2023.
- Yu-Chun Lin, Chung-Che Wang, and Jyh-Shing Jang, "Improving End-to-end Taiwanese-Speech-to-Chinese-Text Translation by Semi-supervised Learning", ROCLING Conference, Taipei, Taiwan, Oct 2023.
- Jun-You Wang, Chon-In Leong, Yu-Chen Lin, Li Su, and Jyh-Shing Roger Jang, "Adapting pretrained speech model for Mandarin lyrics transcription and alignment", IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU), Taipei, Taiwan, Dec 2023.
- Chia-Ying Tsao, Chih-Ting Yeh, Jyh-Shing Roger Jang, Yung-Yaw Chen, and Chuan-Ju Wang, "Multi-behavior Recommendation with Action Pattern-aware Networks", IEEE International Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT), PP. 16-23, 2023.
- Jun-You Wang, Hung-yi Lee1, Jyh-Shing Roger Jang, and Li Su, "Zero-shot singing voice synthesis from musical score", IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU), Taipei, Taiwan, Dec 2023.
- Chung-Che Wang, Ta-Wei Chu, and Jyh-Shing Jang, "Next-Visit Prediction and Prevention of Hypertension Using Routine Health Checkup Data", Proc. 2022 Asia-Pacific Association for Medical Informatics (APAMI), Taipei, Taiwan, Oct 2022.
- Yen-Lun Liao, Chi-Han Lin, Ren-Yuan Lyu, and Jyh-Shing Roger Jang, "Improving ASR in Reverberant Environments", 13th International Symposium on Chinese Spoken Language Processing (ISCSLP), Singapore, Dec. 2022.
- Shu-Fen Tsai, Shih-Chan Kuo, Ren-Yuan Lyu, and Jyh-Shing Roger Jang, "Ensemble and Re-ranking based on Language Models to Improve ASR", 13th International Symposium on Chinese Spoken Language Processing (ISCSLP), Singapore, Dec. 2022.
- Cheng-Tse Wu, Ta-We Chu, and Jyh-Shing Roger Jang, "An Efficient Clustering-Based Feature Selection Method for HighDimensional Large-Scale Datasets", Proc. 2022 Asia-Pacific Association for Medical Informatics (APAMI), Taipei, Taiwan, Oct 2022.
- Po-Hsuan Hsiao (蕭柏宣), Jyh-Shing Roger Jang(張智星) and Chang-Hong Lin (林昶宏), "FashionAI: A Comprehensive Framework for Clothes Segmentation and Recognition", 35th IPPR Conference on Computer Vision, Graphics, and Image Processing (CVGIP), Taiwan, Aug 2022.
- Yen-Lun Liao, Xuanjun Chen, Chung-Che Wang, and Jyh-Shing Roger Jang, "Adversarial Speaker Distillation for Countermeasure Model on Automatic Speaker Verification.", Proc. 2022 ISCA Symposium on Security and Privacy in Speech Communication, Aug 2022.
- Jui-Te Wu, Jun-You Wang, Jyh-Shing Roger Jang, and Li Su, "A Unified Model for Zero-shot Singing Voice Conversion and Sythesis", International Society for Music Information Retrieval (ISMIR), Bengaluru, India, Dec 2022.
- Cheng-Wei Gao (高晟瑋) and Jyh-Shing Roger Jang (張智星), "Head Width Prediction Using Facial Landmark Detection and Head Pose Estimation", 35th IPPR Conference on Computer Vision, Graphics, and Image Processing (CVGIP), Taiwan, Aug 2022.
- Qiu-Xia Zhang, Te-Yu Chi, Te-Lun Yang, and Jyh-Shing Roger Jang, "命名實體識別：結合預訓練模型及對抗訓練的解決方案 (CrowNER at Rocling 2022 Shared Task: NER using MacBERT and Adversarial Training)", The 34th Conference on Computational Linguistics and Speech Processing (ROCLING 2022), Taipei, Taiwan, 2022.
- Yu-Hua Chen, Wen-Yi Hsiao, Tsu-Kuang Hsieh, Jyh-Shing Roger Jang and Yi-Hsuan Yang, "Towards Automatic Transcription of Polyphonic Electric Guitar Music: A New Dataset and a Multi-loss Transformer Model", International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Calgary, Alberta, Canada, May 2022.
- Jimin Wen, Norman Chang, Lang Lin, David Luo, Jyh-Shing Roger Jang, and Hua Chen, "Security Integrity Analytics by Thermal Side-channel Simulation: An ML-augmented Auto-POI Approach", Proceedings of DesignCon, Jan 2022.
- Chung-Che Wang (王崇?), Hsien-Yao Shui (稅顯堯), and Jyh-Shing Roger Jang (張智星), "Chinese Handwritten Style Transfer Using Only 25 Target Examples", 34th IPPR Conference on Computer Vision, Graphics, and Image Processing (CVGIP), Taiwan, Aug 2021.
- Ming-Chi Yen, Wen-Chin Huang, Kazuhiro Kobayashi, Yu-Huai Peng, Shu-Wei Tsai, Yu Tsao, Tomoki Toda, Jyh-Shing Roger Jang, and Hsin-Min Wang, "Mandarin Electrolaryngeal Speech Voice Conversion with Sequence-to-Sequence Modeling", IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), PP. 650-657, Dec 2021.
- Po-Hsuan Hsiao (蕭柏宣), 1 Jun-Qing Liu (劉濬慶), Jyh-Shing Roger Jang(張智星) and Chang-Hong Lin (林昶宏), "A Comprehensive Framework for Bread Image Detection and Recognition for Automatic Bakery Checkout", 34th IPPR Conference on Computer Vision, Graphics, and Image Processing (CVGIP), Taiwan, Aug 2021.
- Jun-You Wang and Jyh-Shing Roger Jang, "On the Preparation and Validation of A Large-Scale Dataset of Singing Transcription", International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Toronto, Canada, March 2021.
- Ji-Han Liu, Cheng-Tse Wu, Ta-Wei Chu and Jyh-Shing Roger Jang, "Data-driven Feature Selection for Long Longitudinal Breadth and High Dimensional Dataset: Empirical Studies of Metabolic Syndrome Prediction", International Conference on Machine Learning and Computing, Feb 2020.
- Hsiao-Ko Chang, Cheng-Tse Wu, Ji-Han Liu, Wee Shin Lim, Hui-Chih Wang, Shu-I Chiu and Jyh-Shing Roger Jang, "Early Detecting In-Hospital Cardiac Arrest Based on Machine Learning on Imbalanced Data", Proceedings of the 7th IEEE International Conference on Healthcare Informatics, Xian, China, Jun 2019.
- Zhe-Cheng Fan, Tak-Shing T. Chan, Yi-Hsuan Yang, and Jyh-Shing R. Jang, "Deep Cyclic Group Networks", International Joint Conference of Neural Networks (IJCNN), Budapest, 2019.
- Ji-Han Liu, Hsiao-Ko Chang, Cheng-Tse Wu, Wee Shin Lim, Hui-Chih Wang, and Jyh-Shing Roger Jang, "Machine Learning Based Early Detection System of Cardiac Arrest", Proceedings of 2019 Conference on Technologies and Applications of Artificial Intelligence (TAAI), Nov 2019.
- Sheng-Hsing Hsiao and Jyh-Shing Roger Jang, "Improving ResNet-based Feature Extractor for Face Recognition via Re-ranking and Approximate Nearest Neighbor", IEEE International Conference on Advanced Video and Signal-based Surveillance (AVSS), Taipei, Taiwan, Sep 2019.
- Yi-Lun Pan, Min-Jhih Haung, Kuo-Teng Ding, Ja-Ling Wu, Jyh-Shing Jang, "k-Same-Siamese-GAN: k-Same Algorithm with GAN for Facial Image De-identi?cation with Hyperparameter Tuning and Mixed Precision Training", IEEE International Conference on Advanced Video and Signal-based Surveillance (AVSS), Taipei, Taiwan, Sep 2019.
- Xuan-Bo Chen, Yueh-Ting Lee, Hung-Shin Lee, Jyh-Shing Roger Jang, and Hsin-Min Wang, "Mandarin Mispronunciation Detection and Diagnosis Feedback Using Articulatory Attributes Based Multi-task Learning", International Conference on Speech Databases and Assessments (Oriental COCOSDA), Taipei, Taiwan, Oct 2019.
- Yueh-Ting Lee, Xuan-Bo Chen, Hung-Shin Lee, Jyh-Shing Roger Jang and Hsin-Min Wang, "Multi-task Learning for Mandarin Acoustic Modeling Using Articulatory Attributes", APSIPA Annual Summit and Conference (APSIPA ASC), Nov 2019.
- Szu-Yu Chou, Jyh-Shing Roger Jang, and Yi-Hsuan Yang, "Learning to recognize transient sound events using attentional supervision", Int. Joint Conf. Artificial Intelligence (IJCAI), Stockholm, Sweden, July 2018.
- Hsiao-Ko Chang, Cheng-Tse Wu, Ji-Han Liu and Jyh-Shing Roger Jang, "Using Machine Learning Algorithms in Medication for Cardiac Arrest Early Warning System Construction and Forecasting", Proceedings of 2018 Conference on Technologies and Applications of Artificial Intelligence (TAAI), Asia University, Taichung, Taiwan, Nov 2018.
- Zhe-Cheng Fan, Yen-Lin Lai, Jyh-Shing Roger Jang, "SVSGAN: Singing voice separation via generative adversarial networks", International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Calgary, Alberta, Canada, April 2018.
- Cheng-Wei Wu, Jen-Yu Liu, Yi-Hsuan Yang, and J.-S. Roger Jang, "Singing Style Transfer Using Cycle-Consistent Boundary Equilibrium Generative Adversarial Networks", Joint Workshop on Machine Learning for Music, Stockholm, Sweden, July 2018.
- Szu-Yu Chou, Li-Chia Yang, Yi-Hsuan Yang, and Jyh-Shing Roger Jang, "Conditional preference nets for user and item cold start problems in music recommendation", IEEE International Conference on Multimedia and Expo (ICME), Hong Kong, July 2017.
- Zhe-Cheng Fan, Tak-Shing T. Chan, Yi-Hsuan Yang, and Jyh-Shing R. Jang, "Music Signal Processing Using Vector Product Neural Networks", International Workshop on Deep Learning for Music (DLM), Anchorage, May 2017.
- Szu-Yu Chou, Yi-Hsuan Yang, Jyh-Shing Roger Jang, and Yu-Ching Lin, " Addressing Cold Start for Next-song Recommendation", Proceedings of the 10th ACM Conference on Recommender Systems (RecSys), PP. 115-118, Boston, Sept 2016.
- Zhe-Cheng Fan, Jyh-Shing Roger Jang, and Chung-Li Lu, "Singing Voice Separation and Pitch Extraction from Monaural Polyphonic Audio Music Via DNN and Adaptive Pitch Tracking", The Second IEEE International Conference on Multimedia Big Data, Taipei, Taiwan, April 2016.
- Chun-Ta Chen and Jyh-Shing Roger Jang, "An Efficient Method for Polyphonic Audio-to-score Alignment Using Onset Detection and Constant Q Transform", International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Shanghai, China, March 2016.
- Pei-Pei Chen, Tzu-Chun Yeh, Jyh-Shing Roger Jang, Wenshan Liou, "AutoRhythm: A Music Game with Automatic Hit-Time Generation and Percussion Identification", International Conference on Multimedia & Expo (ICME), June 2015.
- Pei-Pei Chen, Tzu-Chun Yeh, Jyh-Shing Roger Jang, "AutoRhythm: A Music Game That Turns Any Objects into Your Percussion Instruments", International Conference on Multimedia & Expo (ICME), June 2015.
- T.-S. Chan, T.-C. Yeh, Z.-C. Fan, H.-W. Chen, L. Su, Y.-H. Yang, and J.-S. Jang, "Vocal activity informed singing voice separation with the IKALA dataset", IEEE International Conference on Acoustics, Speech and Signal Processing, April 2015.
Recent Projects (since 2015)（Complete listing (完整列表)）
English title (英文名稱) Chinese title (中文名稱) Role in project (計畫內擔任之工作) Duration (起迄年月) Sponsor agent (補助或委託機構單位) Grant amount in NTD (計畫經費（NTD）) TAIHUCAIS: TAIwan HUmanities Conversational AI Knowledge Discovery System 生成式對話之臺灣人文知識探勘系統計畫 共同主持人 2024/1/1 ~ 2026/12/31 國科會 2000000 Revenue forecasting based on machine learning techniques 以機器學習方法建構財務預測模型 主持人 2023/11/1 ~ 2024/10/31 聯發科技 1200000 使用具有多模態生物識別特徵的機器學習模型來預測巴金森病的風險和病程 主持人 2023/8/1 ~ 2026/7/31 國科會 928000 The Integration of Smart Garments and Data Applications in the fields of Sports Rehabilitation and Precision Exercise 集結智慧衣及數據應用於運動復健與精準運動研發計畫 主持人 2023/6/1 ~ 2024/5/31 國科會 1376504 開發臨床即時檢測與預後系統於慢性腎臟病的精準診斷與治療(2/3) 共同主持人 2022/8/1 ~ 2025/7/31 國科會 1450000 AI Acoustic Evaluation System AI聲學調音與評測系統 主持人 2021/11/1 ~ 2022/10/31 華碩電腦 1300000 Speech Recognition for Chinese News from Mainland 語音辨識模組開發 主持人 2021/10/1 ~ 2022/9/30 國家高速電腦中心 1290000 Advanced Technologies for Designing Trustable AI Services 適用於智慧服務的可信賴AI先進技術研究：（子計畫一）具可信度與可靠度的次世代AI客服 共同主持人 2021/10/1 ~ 2025/9/30 國科會 1500000 Singing Voice Separation via DNN Models on TV SOC Platform 歌聲分離 DNN model 應用於 TV SOC 平台 主持人 2021/6/1 ~ 2021/5/31 瑞昱科技 1500000 Automatic PC quality control and testing systems 自動化個人電腦品質控管測試系統 主持人 2020/11/1 ~ 2021/10/31 和碩聯合科技 1640347 Developing an artificial intelligence-based multidomain sensing platform to predict and early intervene Parkinson's disease in aging society 建立人工智慧多面向分析平台以預測、診斷及介入巴金森氏症與相關神經退化性疾病 主持人 2020/8/1 ~ 2021/7/31 科技部 1004000 Keyword spotting on edge devices 適用於邊緣運算的喚醒詞辨識系統 主持人 2020/6/1 ~ 2021/5/31 聯詠科技 1288000 UAV obstacle avoidance system with computer vision 植基於電腦視覺之無人機避障研究計畫 主持人 2020/1/1 ~ 2020/12/31 中科院 900000 AI Cup: Singing Transcription and Music Chord Recognition AI Cup (歌聲轉譜與和弦辨識競賽) 主持人 2019/11/1 ~ 2021/4/30 教育部 1600000 Textile Industry 4.0: AI Intelligent Color Library on Cloud and Intelligent Application of Dyeing Formulas 紡織業工業4.0AI智慧雲端色庫暨染色配方智慧應用 主持人 2019/11/1 ~ 2020/10/31 科技部 1500000 Applications of AI over FinTech 人工智慧於金融科技之應用 主持人 2019/6/1 ~ 2021/5/31 玉山銀行 10000000 S3: A Universal Music Platform S3: 全方位音樂娛樂學習平台 (2/2) 主持人 2018/12/1 ~ 2019/8/30 科技部 12000000 Plant Image Recognition 植物影像辨識 主持人 2018/1/1 ~ 2018/12/12 工研院 1000000 Developing Artificial Intelligence and IOT Technology on Precision Sleep Medicine 結合人工智慧與物聯網科技發展精準睡眠醫學（分項一：發展居家睡眠呼吸中止篩檢模型） 共同主持人 2018/1/1 ~ 2018/12/31 科技部 2000000 NTU Medical Genie – AI Decision Support System for Precision Medicine (Subproject 4: AI Technologies for Precision Medicine) 臺大醫神–精準醫療人工智慧輔助決策系統《子計畫四：精準醫療人工智慧開發） 共同主持人 2018/1/1 ~ 2018/12/31 科技部 3800000 S3: A Universal Music Platform S3: 全方位音樂娛樂學習平台 (1/2) 主持人 2017/12/1 ~ 2018/11/30 科技部 15000000 Speaker Verification Using Deep Learning 應用深度學習方法之語者驗證技術 主持人 2017/10/20 ~ 2018/10/19 中華電信 990000 Plant Image Recognition 植物影像辨識 主持人 2017/9/1 ~ 2018/8/31 工研院 990000 Systematic Automatic Labeling 系統性自動化貼標 主持人 2017/5/1 ~ 2017/10/31 玉山銀行 630000 Precision Sales and Systematic & Automatic Labeling 精準行銷與系統化自動貼標 主持人 2017/3/1 ~ 2017/10/31 玉山銀行 600000 Big Speech Data Analytics 政府巨量資料分析工具與平台子：子計畫一. 巨量語音資料分析 主持人 2016/7/1 ~ 2017/6/30 科技部 4947298 Research on Music Genre Classification and Scenario classification 歌曲曲風分類器與情境分類器之研究 主持人 2016/4/1 ~ 2016/11/15 工研院 500000 Deep Learning for Music Information Retrieval 用於音樂資訊檢索的深度學習 主持人 2015/8/1 ~ 2018/7/31 科技部 2938000 Audio Fingerprinting & Audio Watermarking 音訊指紋檢索與浮水印嵌入技術 主持人 2015/4/1 ~ 2016/3/31 中華電信 980000 Noise-robust Information Hiding for Audio Signals 抗干擾的音訊資訊隱藏技術 主持人 2015/1/1 ~ 2015/12/15 資策會 600000 Layout Sensitivity Model for NTO/CDU APC Layout Sensitivity Model for NTO/CDU APC 主持人 2014/5/15 ~ 2015/5/14 台積電 900000 Matching and Retrieval Techniques for Large Multimedia Databases 大量媒體特徵資料庫比對搜尋技術 主持人 2014/2/1 ~ 2014/12/15 資策會 800000 Ｗafer Failure Pattern Fingerprint and Similarity Detection 晶圓缺陷樣式辨認及相似度分析 主持人 2013/9/1 ~ 2014/8/31 台積電 500000 GPU-based Music Information Retrieval Systems 以GPU為運算核心之音樂檢索系統 主持人 2013/8/1 ~ 2015/7/31 國科會 795000 Automatic Content Recognition Technology 自動內容辨識技術 主持人 2013/2/1 ~ 2013/12/15 資策會 800000 Integrated R&D Program from Digital Learning to Smart Life 從數位學習到智慧生活的整合研發計畫 共同主持人 2013/1/1 ~ 2015/11/30 國科會 1000000 Wafer Failure Pattern Fingerprint 晶圓缺陷樣式辨認 主持人 2013/1/1 ~ 2013/12/31 台積電 740000 Research and Implementation of Spoken Taiwanese Scoring System 口說台語評分系統之研究與實作 主持人 2012/8/1 ~ 2013/7/31 國科會 523000 The Practice and Implementation of Makeup Transfer 彩妝轉移的實作與探討 主持人 2012/6/1 ~ 2013/5/31 國科會、創意蘿蔔 900000 Technologies for Advanced Music Feature Extraction and Human–Computer Interaction 音樂進階特徵抽取與人機互動技術 主持人 2012/1/1 ~ 2012/12/31 中華電信研究所 980000 Method for Automatic Data Extraction of TV Programs by Voice and Keyword Groups 透過語音與關鍵字組的電視節目自動資料萃取方法 主持人 2012/1/1 ~ 2012/12/15 資策會 600000
Online Tutorials and Toolboxes by Roger Jang
- Online Tutorials
- Toolboxes
Highlights of Our Lab's Participation in MIREX Competition
- 2013
- Ranked 1 out of 11 submissions for Genre Classification
- Ranked 1 out of 23 submissions for Mood Classification
- 2012
- Ranked 1 out of 16 submissions for Genre Classification
- Ranked 2 out of 20 submissions for Mood Classification
- 2011
- Ranked 1 out of 15 submissions for Genre Classification
- Ranked 1 out of 17 submissions for Mood Classification
- 2009
- Ranked 1 out of 3 submissions for subtask 1 of QBSH
- Ranked 1 out of 3 submissions for subtask 2 of QBSH
- Ranked 1 out of 3 submissions for subtask 2 of QBT (Query by Tapping)
- 2007: Ranked 3 out 10 submissions of QBSH
- 2006
- Ranked 1 out of 11 submissions for subtask 1 of QBSH (Query by Singing/Huming)
- Ranked 3 out of 13 submissions for subtask 2 of QBSH