NICF – Advanced NLP with Attention Mechanism and Transformer Architecture | WSQ Courses

Originally published at:

Advanced NLP with Attention Mechanism and Transformer Architecture is a cutting-edge field that uses machine learning and deep learning techniques to improve the processing and understanding of natural language.

This advanced course covers the latest techniques and applications, including attention mechanisms and transformer architecture, enabling you to take your NLP skills to the next level. Through hands-on learning, you will gain the knowledge and practical experience needed to succeed in this rapidly-evolving field.

This course will also cover the ChatGPT models.

Course Objectives

Learners will be able to implement advanced natural language processing (NLP) models with attention mechanism and transformer architecture

Learning Outcomes

By end of the course, learners should be able to:

  • LO1 – Learners will be able to identify the common NLP applications and use cases based on attention mechanisms and transformer architecture
  • LO2 – Learners will be able to perform word embedding and build language models
  • LO3 – Learners will be able to train NLP model with various machine learning approaches.
  • LO4 – Learners will be able to determine NLP strategies based on Hugging Face framework

Course Brochure


Skills Framework

This course follows the guideline of Text Analytics and Processing ICT-DIT-5029-1.1 TSC under ICT Skills Framework


Two e-certificates will be awarded to trainees who have demonstrated competency in the WSQ assessment and achieved at least 75% attendance.

  • A SkillsFuture WSQ Statement of Attainment (SOA) issued by WSG. Typically will take 3-4 weeks.
  • Certification of Completion issued by Tertiary Infotech Pte Ltd issued after the class.

WSQ Funding

WSQ funding is only applicable to Singaporeans and PR. Subject to eligibility, the funding support is subjected to funding caps.

Effective for courses starting from 1 Jan 2023
Full Fee GST Nett Fee after Funding (Incl. GST)
Baseline MCES / SME
$688 $55.04 $399.04 $261.44

Baseline: Singaporean/PR age 21 and above
MCES(Mid-Career Enhanced Subsidy): S’porean age 40 & above

WSQ TG Application Form

Eligible individuals and company can apply for WSQ TG. Please login to Skilleto and fill in the required details for grant application. Please click here to submit for WSQ TG

Please do not pay upfront. We will advise you on the eligibility and nett fee after registration. Company sponsored staff are eligible for Absentee Payroll.

After the WSQ subsidy, you can offset the nett fee by the following :

SkillsFuture Enterprise Credit (SFEC)

Eligible Singapore-registered companies can tap on $10000 SFEC to cover out-of-pocket expenses.Click here to submit SkillsFuture Enterprise Credit

SkillsFuture Credit

Eligible Singapore Citizens can use their SkillsFuture Credit to offset course fee payable after funding. Click here for SkillsFuture Credit submission


Eligible Singapore Citizens can use their PSEA funds to offset course fee payable after funding. Click here for ad-hoc PSEA application form.


Courses are provided by