WSQ - Fine-Tuning LLM Models and RAG

Topic 1 Introduction to Large Language Models (LLM) and AI Agents

• Overview of transformer architecture and attention mechanisms in LLMs
• Introduction to AI agents
• NLP applications Powered by LLM and AI agents
• Use cases of LLMs and AI agents

Topic 2 Retrieval-Augmented Generation (RAG)

• Introduction to Retrieval-Augmented Generation (RAG)
• Use cases of RAG
• Overview of tokenization and word embeddings
• Overview of chunking strategies and vector databases
• Build a RAG system

Topic 3: Fundamentals of Fine Tunning LLM

• Fundamentals of LLM Fine Tuning
• Supervised Fine-Tuning (SFT) for custom LLM Tasks
• Parameter Efficient Fine Tuning (PEFT)
• Low-Rank Adaptation (LoRA) for fine tuning LLM
• Group Relative Policy Optimization (GRPO)
• Reinforcement Learning (RT Learning) for fine tunning

Topic 4 Fine Tuning LLM Implementation and Deployments

• Overview of Hugging Face Fine Tuning Libraries
• Implementing Fine Tuning wiht Hugging Face Libraires
• Using Hugging Face datasets and tokenizers for LLMs fine tunning
• Deploying and testing Fine-Tuned models

Final Assessment

• Written Assessment - Short Answer Questions (WA-SAQ)
• Practical Performance (PP)

Promotion Code

Promo or discount cannot be applied to WSQ courses

Minimum Entry Requirement

Knowledge and Skills

• Able to operate using computer functions
• Minimum 3 GCE ‘O’ Levels Passes including English or WPL Level 5 (Average of Reading, Listening, Speaking & Writing Scores)

Attitude

• Positive Learning Attitude
• Enthusiastic Learner

Experience

• Minimum of 1 year of working experience.

Minimum Software/Hardware Requirement

Software:

You can download and install the following software:

• BERT

Hardware: Windows and Mac Laptops

About Progressive Wage Model (PWM)

The Progressive Wage Model (PWM) helps to increase wages of workers through upgrading skills and improving productivity. 

Employers must ensure that their Singapore citizen and PR workers meet the PWM training requirements of attaining at least 1 Workforce Skills Qualification (WSQ) Statement of Attainment, out of the list of approved WSQ training modules.

For more information on PWM, please visit MOM site.

Funding Eligility Criteria

Steps to Apply Skills Future Claim

• The staff will send you an invoice with the fee breakdown.
• Login to the MySkillsFuture portal, select the course you’re enrolling on and enter the course date and schedule.
• Enter the course fee payable by you (including GST) and enter the amount of credit to claim.
• Upload your invoice and click ‘Submit’

SkillsFuture Level-Up Program

The  SkillsFuture Level-Up Programme provides greater structural support for mid-career Singaporeans aged 40 years and above to pursue a substantive skills reboot and stay relevant in a changing economy. For more information, visit SkillsFuture Level-Up Programme

Get Additional Course Fee Support Up to $500 under UTAP

The Union Training Assistance Programme (UTAP) is a training benefit provided to NTUC Union Members with an objective of encouraging them to upgrade with skills training. It is provided to minimize the training cost. If you are a NTUC Union Member then you can get 50% funding (capped at $500 per year) under Union Training Assistance Programme (UTAP).

For more information visit NTUC U Portal – Union Training Assistance Program (UTAP)

Steps to Apply UTAP

• Log in to your U Portal account to submit your UTAP application upon completion of the course.

Note

• SSG subsidy is available for Singapore Citizens, Permanent Residents, and Corporates.
• All Singaporeans aged 25 and above can use their SkillsFuture Credit to pay. For more details, visit www.skillsfuture.gov.sg/credit
• An unfunded course fee can be claimed via SkillsFuture Credit or paid in cash.
• UTAP funding for NTUC Union Members is capped at $250 for 39 years and below and at $500 for 40 years and above.
• UTAP support amount will be paid to training provider first and claimed after end of class by learner.

Appeal Process

1. The candidate has the right to disagree with the assessment decision made by the assessor.
2. When giving feedback to the candidate, the assessor must check with the candidate if he agrees with the assessment outcome.
3. If the candidate agrees with the assessment outcome, the assessor & the candidate must sign the Assessment Summary Record.
4. If the candidate disagrees with the assessment outcome, he/she should not sign in the Assessment Summary Record.
5. If the candidate intends to appeal the decision, he/she should first discuss the matter with the assessor/assessment manager.
6. If the candidate is still not satisfied with the decision, the candidate must notify the assessor of the decision to appeal. The assessor will reflect the candidate’s intention in the Feedback Section of the Assessment Summary Record.
7. The assessor will notify the assessor manager about the candidate’s intention to lodge an appeal.
8. The candidate must lodge the appeal within 7 days, giving reasons for appeal 
9. The assessor can help the candidate with writing and lodging the appeal.
10. he assessment manager will collect information from the candidate & assessor and give a final decision.
11. A record of the appeal and any subsequent actions and findings will be made.
12. An Assessment Appeal Panel will be formed to review and give a decision.
13. The outcome of the appeal will be made known to the candidate within 2 weeks from the date the appeal was lodged.
14. The decision of the Assessment Appeal Panel is final and no further appeal will be entertained.
15. Please click the link below to fill up the Candidates Appeal Form.

• NLP Engineer
• Data Scientist (specializing in text data)
• Machine Learning Engineer (NLP focus)
• Computational Linguist
• AI Research Scientist (language models)
• Chatbot Developer
• Text Mining Specialist
• AI Solutions Architect (with NLP projects)
• Conversational AI Designer
• Search Algorithm Developer
• Recommendation System Engineer (content-based)
• Content Analysis Engineer
• Information Retrieval Specialist
• Machine Translation Developer
• Speech Recognition Engineer.