Categories

Dev Log LLM / Multimodal Natural Language Processing Natural Language Processing and Linguistics Project Log Machine Learning, Deep Learning Linguistics | English Linguistik | Germanistik Language ETC.

Dev Log

Web Auto crawling + Retrieval 🌐♾️ 20 Nov 2024

Video Retrieval system 📽️ 01 Nov 2024

OCR+RAG: End-to-End system (Vision Grid Transformer) 30 Sep 2024

Daily AI report with Git Action 27 Sep 2024

Streaming search system : Function calling based ReAct Agents 09 Sep 2024

Search system : #ReACT #HITL #Multi-Agent 08 Aug 2024

OCR+RAG: End-to-End system (YOLO) 30 Jul 2024

Self-RAG + CRAG : Query Router | Reranker | Relevant Grader | Hallucination Grader | Answer Grader 01 Jul 2024

한국어 PDF Parser / PDF OCR (layout detection + text extraction) 02 Feb 2024

Advanced RAG 02 Jan 2024

LLM Tuning / Merge 31 Mar 2023

NER(Named Entity Recognition) 25 Sep 2022

Sentiment Analysis 24 Sep 2022

ㅡ 27 Oct 2019

LLM / Multimodal

Agent? : AI Agents, Agentic AI, Multi-Agent 04 Feb 2025

DeepSeek-V3 14 Jan 2025

LLM Attention (with Code) 24 Dec 2024

Meta-Chunking: Learning Efficient Text Segmentation via Logical Perception 14 Nov 2024

RAGCache: Efficient Knowledge Caching for Retrieval-Augmented Generation 10 Nov 2024

🚶‍➡Generative Agents: Interactive Simulacra of Human Behavior 04 Nov 2024

Entropix : Entropy Based Sampling and Parallel CoT Decoding 10 Oct 2024

Speculative Decoding 15 Sep 2024

Vision : Self-Attention vs. Cross-Attention 10 Sep 2024

Semantic Entropy: Summary of Two Papers on LLM Hallucination Detection 😱 06 Aug 2024

LLaMa 3.1 01 Aug 2024

MoE, MoA 22 Jun 2024

Merge algorithms 20 Jun 2024

Key-Value caching 18 Jun 2024

DocLLM: A layout-aware generative language model for multimodal document understanding 04 Jun 2024

VLM : Models Summary(unfinished post) 30 May 2024

VLM : Architecture / Fusion Methods 29 May 2024

VLM : Applications 28 May 2024

LLaVA : Visual Instruction Tuning 11 May 2024

LLaMa 3 01 May 2024

Fine-tuning variations : RLHF/PPO, DPO, ORPO 04 Apr 2024

RAG : Embedding Model, Reranking Model 05 Mar 2024

RAG : Similarity search (Keyword Search, Semantic Search, Hybrid Search) 04 Mar 2024

RAG : Query Transformation/ Query Routing 03 Mar 2024

RAG(Retrieval-Augmented Generation) 21 Feb 2024

Mistral 7B 04 Dec 2023

LLAMA 2: Open Foundation and Fine-Tuned Chat Models 10 Oct 2023

Quentization basic 05 Oct 2023

PEFT : Parameter-Efficient Finetuning methods 04 Oct 2023

About Fine-tuning 02 Oct 2023

LLM Architecture 01 Oct 2023

Multimodal Learning with Transformers : A Survey 28 Sep 2023

ㅡ 29 Oct 2019

Natural Language Processing

Prompt-Based Learning 3 | P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Tasks 13 Jan 2023

Prompt-Based Learning 2 | P-tuniung: GPT Understands, Too 21 Dec 2022

Prompt-Based Learning 1 | PET(Pattern Exploiting Training), iPET(Iterative Pattern Exploiting Training) 15 Dec 2022

Language Models Summary(unfinished post) 30 Nov 2022

DAPT-TAPT | Don’t Stop Pretraining: Adapt Language Models to Domains and Tasks 29 Nov 2022

BERT | Pre-training of Deep Bidirectional Transformers for Language Understanding 22 Nov 2019

Transformer | Attention Is All You Need 19 Nov 2019

Attention in sequence to sequence 12 Nov 2019

Sequence to Sequence(Seq2Seq) 11 Nov 2019

GloVe(Global Word Vectors) 07 Nov 2019

FastText | Enriching Word Vectors with Subword Information 07 Nov 2019

Word2vec | Skip-gram 06 Nov 2019

Word2Vec(Sentimental Categorize);with code 06 Nov 2019

Word2vec | CBOW(Continuous Bag Of Words Model) 05 Nov 2019

NPLM(Neural Probabilistic Language Model) 04 Nov 2019

Word embedding(Distributed Representation) 03 Nov 2019

LSA(Latent Sematic Analysis) 03 Nov 2019

How to represent words?( Word Vectors) 01 Nov 2019

Tokenization;with code 31 Oct 2019

Regular Expression;with code 31 Oct 2019

NLP Basics;with code 31 Oct 2019

What is Natural Language Processing(NLP)? 30 Oct 2019

Natural Language Processing and Linguistics

Coreference Resolution | Speech and Language Processing(Daniel Jurafsky and James H. Martin, 2019) 24 Apr 2021

Investigating BERT’s Knowledge of Language:Five Analysis Methods with NPIs(Warstadt et al.(2019)) 07 Apr 2021

Assessing the ability of Transformer-based Neural Models to represent structurally unbounded dependencies(Da Costa.J et al.(2020)) 04 Apr 2021

What does BERT learn about the structure of language?(Jawahar.G(2019)) 01 Apr 2021

Contextual word representation 30 Mar 2021

A Structural Probe for Finding Syntax in Word Representations(Hewitt.J(2019)) 07 Mar 2021

Linguistic Knowledge and Transferability of Contextual Representations(Liu(2019)) 17 Jan 2021

What Can Linguistics and Deep Learning Contribute to Each Other? (Linzen et al. (2019)) 16 Jan 2021

ㅡ 31 Oct 2019

Project Log

Project list 01 Jan 2022

ㅡ 02 Dec 2019

Machine Learning, Deep Learning

Linear Regression;with code 07 Aug 2021

K-Means;with code 03 Aug 2021

L1, L2 (Norm, Loss, Regularization) 04 Oct 2020

Transfer Learning, Multi-task Learning, End-to-End deep learning 01 Oct 2020

Linguistics | English

Long-Distance Dependency(LDD) 04 Apr 2021

Conversation Analysis | Adjacency Pair: Action and Understanding 05 Nov 2020

Conversation Analysis | Preference Structure 04 Nov 2020

Conversation Analysis | Turn-Taking 03 Nov 2020

Conversation Analysis | Conversation Analysis Methods 02 Nov 2020

Conversation Analysis | Conversation Analysis 01 Nov 2020

ㅡ 02 Oct 2020

Linguistik | Germanistik

Textlinguistik 14 Dec 2020

Pragmatik 13 Dec 2020

Semantische Theoriebildung 12 Dec 2020

Semantische Grundbegriffe 11 Dec 2020

Attribute und syntaktische Einzelprobleme 10 Dec 2020

Ergaenzungen und Angaben 09 Dec 2020

Dependenz und Valenz 08 Dec 2020

Traditionelle Syntaxanalyse 07 Dec 2020

Wordbildung und Flexion 06 Dec 2020

Morphologie 05 Dec 2020

Phonetik und Phonologie 03 Dec 2020

Semiotik 02 Dec 2020

Sprache und Linguistik 01 Dec 2020

Language

Deutsch | Wendung2 16 May 2021

Deutsch | Wendung 25 Apr 2021

Deutsch | Grammatik 02 Jan 2021

ETC.

1234 22 May 2022

Docker 13 Jan 2022

Linux 12 Jan 2022

Git | Commit Rebase 10 Jul 2021

Git | Branch 08 Jul 2021

Git | Repository 05 Jul 2021

color test 24 Jan 2021