# Fuzzy Logic
> Keywords: Fuzzy Control、Fuzzy Machine Learning、Fuzzy Neural Network
## Conference
#### International
[IEEE WCCI](https://wcci2020.org/fuzz-sessions/)
[IEEE CEC]()
[IEEE SMC]()
#### Domestic
[FUZZ-IEEE](https://attend.ieee.org/fuzzieee-2021/)
[中華民國模糊學會Taiwan Fuzzy Systems Association (TFSA)](http://www.fuzzy.org.tw/wordpress/)
[中華民國人工智慧學會 (TAAI)](http://www.taai.org.tw/)

## Competitions
[FML-based Machine Learning Competition ](http://oase.nutn.edu.tw/wcci2020-fmlcompetition/overview.php)
[Competitions FUZZ-IEEE 2021](https://attend.ieee.org/fuzzieee-2021/competition/)

## Tutorial
[Fuzzy Logic Tutorial](https://www.tutorialspoint.com/fuzzy_logic/index.htm)
[Neuro-Fuzzy System](https://www.youtube.com/watch?v=7C19X6pJEuU)
[Fuzzy Logic in Artificial Intelligence | Introduction to Fuzzy Logic & Membership Function](https://www.youtube.com/watch?v=xD1c8jTFF78)
[Fuzzy Implications](http://www.dia.fi.upm.es/~mgremesal/MIR/slides/Lesson%209%20(Selection%20of%20Fuzzy%20Implications).pdf)
[模糊理論筆記](https://irw.ncut.edu.tw/peterju/fuzzy.html)
[模糊系統(推)](http://neuron.csie.ntust.edu.tw/homework/93/Fuzzy/%A4%E9%B6%A1%B3%A1/homework_2/D9107302_2/new_page_1.htm)
[類神經模糊網路簡介](http://faculty.stust.edu.tw/~tang/fuzzy/fuzzy_neural.htm)

## Research
Fuzzy Computing with Words
Fuzzy control and intelligent systems
Fuzzy decision making and decision support systems
Fuzzy logic and fuzzy set theory
Fuzzy optimization and design
Fuzzy pattern recognition
Fuzzy systems for robotics
Type-2 fuzzy logic
[Explainable AI: Data-driven Fuzzy Systems](https://www.iis.sinica.edu.tw/zh/page/Events/data/DJ190010.html)
[Fuzzy Systems for Explainable Artificial Intelligence](https://www.frontiersin.org/research-topics/16553/fuzzy-systems-for-explainable-artificial-intelligence)

## Advanced Areas of Fuzzy Logic
- Fuzzy logic systems
- Fuzzy-database
- Fuzzy mathematics
- Fuzzy-logic algorithms and also techniques
- Fuzzy decision support system
- Fuzzy-mathematical programming
- Fuzzy expert system
- Fuzzy-neural systems and also fuzzy neuro systems
- Fuzzy systems modeling and also identification
- Fuzzy-pattern recognition
- Fuzzy process control
- Fuzzy-reasoning system
- Fuzzy rule based system
- Imprecise probability and also possibility theory
- Fuzzy system also in web based applications
- Fuzzy-system in Multimedia
- Hybrid fuzzy systems (Fuzzy-Neuro-Evolutionary-Rough)
- Fuzzy-System Applications in Computer vision
- Fuzzy System Applications also based in E-Commerce
- Fuzzy-Sets in Bio-Informatics
- Fuzzy System Applications also based in Human-Machine-Interface
- Fuzzy System Applications in Control and also system engineering
- Fuzzy system applications also based in Robotics

## Current Research Areas of Fuzzy logic
- Telecommunication systems
- Data mining
- Medical Imaging
- Multimedia application
- Intrusion Detection System
- Information Retrieval
- Fuzzy Decision Tree
- Knowledge and Systems Engineering
- Advanced Fuzzy Robotics
- Computer vision and image processing
- And also in Tradition control systems to conventional control systems

## Paper Submit
1. [IEEE Transactions on Fuzzy Systems](https://ieeexplore.ieee.org/xpl/RecentIssue.jsp?punumber=91)
2. [IEEE International Conference on Fuzzy Systems](https://ieeexplore.ieee.org/xpl/conhome/8845563/proceeding)
3. [International Journal of Fuzzy Systems](https://www.springer.com/journal/40815)
4. [International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems](https://www.worldscientific.com/worldscinet/ijufks)
5. [Fuzzy Sets and Systems](https://www.sciencedirect.com/journal/fuzzy-sets-and-systems)
6. [International Journal of Smart Computing and Information Technology (IJSCIT)](http://bohrpub.com/journals/IJSCIT/IJSCIT.html)
7. [Journal of Ambient Intelligence and Humanized Computing (AIHC)](https://www.springer.com/journal/12652)

## Popular Topic
- [FuFuzzAttention on Session-based Recommender System](https://ieeexplore.ieee.org/document/8858856)
- [Superpixel-Based Fast Fuzzy C-Means Clustering For Color Image Segmentation](https://ieeexplore.ieee.org/document/8584141)
- [Fast Training Algorithms For Deep Convolutional Fuzzy Systems With Application To Stock Index Prediction](https://ieeexplore.ieee.org/document/8788632)
- [Automatic Fuzzy Clustering Framework For Image Segmentation]([https://ieeexplore.ieee.org/document/8788632/](https://ieeexplore.ieee.org/document/8770118))
- [A Deep Neuro-Fuzzy Network for Image Classification](https://github.com/SonbolYb/Deep-Neuro-Fuzzy)
- [Hybrid Deep Learning Type-2 Fuzzy Logic Systems For Explainable AI](https://ieeexplore.ieee.org/document/9177817)
- [Neuro-Fuzzy Classification](https://moscow.sci-hub.se/4238/13084292d69d3c1cdbdc03d08ae588eb/meyer-baese2014.pdf#view=FitH)
- [Supervised fuzzy partitioning](https://www.sciencedirect.com/science/article/abs/pii/S0031320319303164)
- [Fuzzy Bayesian Learning](https://arxiv.org/abs/1610.09156)
- [Fuzzy Pruning for Compression of Convolutional Neural Networks](https://ieeexplore.ieee.org/document/8858894)

## Neural Fuzzy Network
1. [Neuro-Fuzzy Systems: A Survey](http://cee.uma.pt/morgado/Down/483-343.pdf)
2. [Adaptation of Fuzzy Inference System Using Neural Learning](http://www.softcomputing.net/nf_chapter.pdf)
3. [Neuro Fuzzy Systems: State-of-the-art
Modeling Techniques](https://arxiv.org/pdf/cs/0405011.pdf)

### 均勻式切割法
#### ANFIS
- [J.-S. R. Jang (張智星), "ANFIS: Adaptive-Network-based Fuzzy Inference Systems," IEEE Trans. on Systems, Man, and Cybernetics, vol. 23, pp. 665-685, May 1993.
](https://ieeexplore.ieee.org/document/256541/)
- [好文推薦](http://sirlis.cn/deep-learning-ANFIS/)
- [An ANFIS framework for PyTorch](http://www.cs.nuim.ie/~jpower/fuzz-poster.pdf)

#### FALCON
- [C.-T. Lin, "Fuzzy adaptive learning control network with on-line neural learning," Fuzzy Sets and Systems , vol. 71, pp. 25-45, April 1995.
](https://www.sciencedirect.com/science/article/abs/pii/016501149400195D)

#### Back-propagation fuzzy system
- [Li-Xin Wang 、Jerry M. Mendel , "Back-propagation fuzzy system as nonlinear dynamic system identifiers," IEEE International Conference on Fuzzy Systems, pp. 1409-1418, March 1992.
](https://ieeexplore.ieee.org/document/258711)

### 非均勻式切割法
#### Fuzzy HyperRectangular Composite Neural Network
- [Mu-Chun Su, "Rule Extraction Using a Novel Class of Fuzzy Degraded Hyperellipsoidal Composite Neural Networks", Lecture Notes in Computer Science, vol 999. Springer, May 2005.](https://tkuir.lib.tku.edu.tw/dspace/retrieve/76948/Rule+extraction+using+a+novel+class+of+fuzzy+degraded+hyperellipsoidal+composite+neural+networks.pdf)

## Coding
- [[Python] FuzzyLogicToolBox](https://github.com/Luferov/FuzzyLogicToolBox)
- [[Python] scikit-fuzzy ](https://github.com/scikit-fuzzy/scikit-fuzzy)
- [[MATLAB] Fuzzy Logic Toolbox](https://www.mathworks.com/products/fuzzy-logic.html)
- [[Java] Library for the Fuzzy Markup Language](http://www.uco.es/JFML/)
- [An ANFIS framework for PyTorch](http://www.cs.nuim.ie/~jpower/fuzz-poster.pdf)
- [[Java Tool] VisualFMLTool](http://kws.nutn.edu.tw/fml/)

## Future Research
### 使用遷移學習（Transfer Learning）應用於 ANFIS
由於帶標記的訓練樣本數量有限。比如，處理受試者A領域（target domain）生理訊號的情緒分類問題時，缺少足夠的訓練樣本。同時，與A領域相關的B領域（source domain），擁有大量的訓練樣本(情緒標記)，但B領域與A領域處於不同的特徵空間或樣本服從不同的分佈。這時使用知識遷移（knowledge transfer）是一個不錯的選擇[1]，即把B領域中的知識遷移到A領域中來，提高A領域分類效果，不需要花大量時間去標註A領域數據。遷移學習，做為一種新的學習範式，被提出用於解決這個問題。


- Fine-tune
- 複製模型的參數當作初始參數，再用自己的訓練資料進行微調
(借用的參數會被改變)
- Layer transform
- 只借用模型的部分神經層參數，並在訓練的過程中凍結該層參數，不更新。只訓練後半部分少數參數

### 時間序列模型結合ANFIS
RNN 最特別的一點是它有記憶的神經網路。RNN做的內容就是假設我今天輸入了一筆數據進去，神經網路不但會輸出一個y。他還會偷偷的把這些資訊傳到下一次的輸入，因此下一次不僅是輸入X2，還偷偷包含了一組剛剛傳出來的數據。把這些合併起來才會產生出來一個新的y。因此在有時間序列的模型我們將輸入對調他跑出來的結果也會不一樣的。

常見的 RNN 模型如下:
- Simple RNN
- Long Short-Term Memory (LSTM)
- Gate Recurrent Unit (GRU)

架構如下圖所示，假設RNN 的 window size設為 10，即代表每十個時間點的腦波生理訊號為一組資料丟入時間序列模型。每一個時間點的輸入都會產生一組隱藏層狀態(hidden state)，因此 RNN 模型會產出 10 組的隱藏層狀態，之後我們將這些資訊攤平(Flatten)作為 ANFIS 的輸入進行模糊推論。ANFIS 經由一系列運算後產生 N 條規則輸出，最後再將這些輸出放入DNN全連階層進行情緒分類。


### 1D-CNN 時序行資料結合 ANFIS
卷積神經網絡（CNN）非常適合處理影像識別問題，其原因是透過卷積層能夠萃取出圖片中的細微特徵。其中我們可以將ㄧ維的時序行資料利用卷積的概念將時間類型的資料進行特徵萃取。1D-CNN主要用於輸入是連續的情境，例如文本、音頻以及訊號。


### Attention注意力機制結合 ANFIS
不使用 RNN、CNN 等模型，只使用 encoder 和 decoder 模型加上 attention 機制就有非常好的結果[2]，此新的網路架構稱為「Transformer」。最早由Google團隊於2017年提出，且在自然語言處理上有不錯的效果。我們可以將Attention 的概念建立在時序資料上，將連續性的資料加上注意力機制，讓模型為時序資料保留重要特徵進行情緒分類。


---

## Paper Resource
[Recent papers in Fuzzy Logic](https://www.academia.edu/Documents/in/Fuzzy_Logic)

## Article
- [科技大觀園-模糊理論](https://scitechvista.nat.gov.tw/c/s9Oc.htm)
- [ANFIS: Adaptive Network-Based. Fuzzy Inference System](https://homepage.iis.sinica.edu.tw/~jdwei/ai2011/PPT/ANFIS.pdf)
- [What is Fuzzy Logic in AI and What are its Applications?](https://www.edureka.co/blog/fuzzy-logic-ai/#fuzzy)
- [使用 Python 編寫基於模糊邏輯的 AI 股票預測系統](https://botnotes.net/2021/02/15/fuzzy-stock/)

## Material
What is the greatest achievement of fuzzy theory in the all applications area and scientific work?
- Simply we can say, where the uncertainty occur, the fuzzy can play a major role.

## Reference
- [FUZZY LOGIC PROJECTS](https://phdtopic.com/fuzzy-logic-projects/)