Publications

Peer-Reviewed Publications (9)
  • AACL-IJCNLP 2026 · 2026 · First Author
    Private Evaluation Protocol: Contamination-Resistant Black-Box Evaluation via Public-Slice Surrogates
    Md. Mahadi Hasan, Sazzadur Rahaman, Yusuf Sarwar Uddin, Santu Karmaker
  • ACL 2026 Findings · 2026 · First Author
    Large Language Models for IT Automation Tasks: Are We There Yet?
    Md. Mahadi Hasan, John Salvador, Akond Ashfaque Ur Rahman, Shubhra Kanti Karmaker Santu
    Paper
  • ACL 2026 Main · 2026 · Second Author
    The Path Not Taken: Duality in Reasoning about Program Execution
    Eshgin Hasanov, Md. Mahadi Hasan Sibat, Santu Karmaker, Aashish Yadavally
    Paper
  • NAACL 2025 · 2025
    LLMs as Meta-Reviewers' Assistants: A Case Study
    Eftekhar Hossain, Sanjeev Kumar Sinha, Naman Bansal, Alex Knipper, Souvika Sarkar, John Salvador, Yash Mahajan, Sri Guttikonda, Mousumi Akter, Md. Mahadi Hasan Sibat, et al.
    Paper
  • FSE 2024 · 2024 · First Author
    State Reconciliation Defects in Infrastructure as Code
    Md. Mahadi Hasan, John Salvador, Shubhra Kanti Karmaker Santu, Akond Ashfaque Ur Rahman
    Paper
  • TMLR 2024 · 2024 · First Author
    Introducing Forecast Utterance for Conversational Data Science
    Md. Mahadi Hasan, R. Alexander Knipper, Shubhra Kanti Karmaker Santu
    Paper
  • ICPE 2024 · 2024
    Processing Natural Language on Embedded Devices: How Well Do Transformer Models Perform?
    Souvika Sarkar, Mohammad Fakhruddin Babar, Md. Mahadi Hasan, Monowar Hasan, Shubhra Kanti Karmaker Santu
    Paper
  • AACL-IJCNLP 2022 · 2022 . Second Author
    Analogy-Guided Evolutionary Pretraining of Binary Word Embeddings
    R. Alexander Knipper, Md. Mahadi Hasan, Mehdi Sadi, Shubhra Kanti Karmaker Santu
    Paper
  • ACM CSUR 2022 · 2022 . Second Author
    AutoML to Date and Beyond: Challenges and Opportunities
    Shubhra Kanti Karmaker Santu, Md. Mahadi Hasan, Micah J. Smith, Lei Xu, Chengxiang Zhai, Kalyan Veeramachaneni
    Paper
Manuscripts & Preprints
  • Under Review . Second Author
    Beyond Exact Match: The Spectrum of Repetitiveness in Code
    Eshgin Hasanov, Md. Mahadi Hasan Sibat, Santu Karmaker, Aashish Yadavally
    Paper
  • Preprint · 2026
    FinTradeBench: A Financial Reasoning Benchmark for LLMs
    Yogesh Agrawal, Aniruddha Dutta, Md. Mahadi Hasan Sibat, Santu Karmaker, Aritra Dutta
    Paper
  • Preprint · 2023
    Large Language Models as Your Personal Data Scientist
    Md. Mahadi Hasan, Alex Knipper, Shubhra Kanti Karmaker Santu
    Paper