TASK FOR THE COURSE ASSIGNMENT
Course: Deep Learning for Cognitive
Computing: Theory
The major objective:
During
the assignment you are supposed to find, select, learn, apply, and evaluate a diverse
set of available online artificial intelligence (AI), machine learning (ML), cognitive
computing (CC), and Generative AI (GenAI) services to design the task below,
which is Cognitive Profile of your own (preferable choice) or of someone else
(publicly known person or celebrity).
The task:
The
task for the assignment would be creation and visualization of your own Cognitive
Profile using available online demos of the cognitive computing
services. You are supposed to find yourself or/and use some from the list of
available online services (see below few examples), try some of their demos and
design your personal profile in a similar (preferably better) way as the
partial profiles of Vagan, Pekka, Donald and others were presented in https://ai.it.jyu.fi/vagan/DL4CC_Part-1.pptx.
(Notice that in this huge file, the
slides, which contain examples related to your assignment, are marked with the
white clickable letter A within
violet circle). For designing your profile, you are supposed to take samples of
your writings (academic texts, blogs, etc.), speeches, photos, and videos as
inputs for these services and then embed the outcomes to your Cognitive
Profile represented as the PowerPoint presentation. At the end of the
presentation, provide a few conclusive slides aiming to answer
the questions:
·
How powerful are the services (AI/ML/CC/GenAI) used? What are their strengths
and weaknesses? Which of them do I like most and why?
·
What could be potential use-cases
and future applications, which may benefit from such cognitive profiles as have
been designed?
·
What could be potential dangers associated with exposing such profiles
publicly and why?
NOTE:
While designing and presenting the Cognitive Profile you
are encouraged to use as much as possible, as diverse as possible, and as many
as possible the available online AI/ML/CC/GenAI tools and services.
While addressing the conclusive questions above you are
supposed to provide your own thoughts, and the use of the AI/ML/CC/GenAI tools
and services is not allowed.
Please
name the resulting PowerPoint (.pptx) file as Firstname_Familyname.pptx to your
personal Web space (e.g., the one provided by the university on users.jyu.fi)
and send the link to the course instructor (via university email address)
before the deadline. The more different details you include to the profile, the
more different services you will find and properly use for that, and the more
interesting use-cases you invent - the better grade for the course will be
given. In this course (Deep Learning for Cognitive Computing: Theory) you are
not supposed (but you may if you want and capable) to program anything or use
programmable APIs to make your cognitive profile; the use of online demos
through GUIs will be enough.
Personal data
security note:
Please carefully consider and take into
account this note before you start the actual work on the assignment.
Both you and the teachers must
ensure that the assignment content and student-to-teacher assignment storage
and delivery protocol comply with the university policy and general data
protection regulation (carefully read our university policies regarding data
security.
Your assignment on Cognitive
Profile is supposed to include: (a) before processing, samples of your
texts, speeches and images and (b) after processing, discovered cognitive
features of yours. Therefore, make sure that no input files contain any private
or sensitive information. Also, make sure that you keep the assignment in a
safe place. During the delivery: (1) preferable option: email from your
university mail account to the teacher’s university account and
supply email with the attached assignment (if file larger than 10 M, you can
use safe university cloud services for storing and delivery); (2) or upload
file to the password-protected subdirectory of your personal university web
space (if available) and supply the teacher with the link and a one-time
password for download.
After teacher confirms successful file download, you can remove the file
from the cloud or the web directory. The teacher will not disclose the file to
anyone; will keep it in a safe place about 2 years and delete after your
graduation.
SOME EXAMPLES
OF Cognitive Computing Services Online (could be incomplete and include outdated services):
TEXT-TO-TEXT
A. Summarization
http://textsummarization.net/text-summarizer ;
https://deepai.org/machine-learning-model/summarization
;
https://quillbot.com/summarize ;
https://algorithmia.com/algorithms/nlp/Summarizer
;
https://chat.openai.com/chat
;
B. Generation
https://talktotransformer.com/ ;
https://deepai.org/machine-learning-model/text-generator
;
https://www.poem-generator.org.uk/
;
https://app.inferkit.com/demo
;
https://chat.openai.com/chat
;
C. Translation
https://translate.google.com ;
https://www.deepl.com/translator ;
https://www.ibm.com/demos/live/watson-language-translator/self-service/home
;
https://chat.openai.com/chat ;
D. Question & Answer
https://www.pragnakalp.com/demos/BERT-NLP-QnA-Demo/ ;
https://deeplearninganalytics.org/demos/
;
https://dida.do/demos/question-answering
;
https://chat.openai.com/chat ;
TEXT-TO-SPEECH
https://www.ibm.com/demos/live/tts-demo/self-service/home
;
https://azure.microsoft.com/en-us/products/cognitive-services/text-to-speech/
;
https://cloud.google.com/text-to-speech#section-2
;
https://www.naturalreaders.com/online/
;
https://www.descript.com/ai-voices
;
TEXT-TO-SEMANTICS (understanding, tone, emotions, personality, essential content, etc.)
https://www.ibm.com/demos/live/natural-language-understanding/self-service/home
;
https://aidemos.microsoft.com/text-analytics
;
https://cloud.google.com/document-ai
;
https://www.intelligenceapi.com/demo/
;
https://deepai.org/machine-learning-model/sentiment-analysis
;
https://deepai.org/machine-learning-model/text-tagging
;
https://www.entitysearch.io/#demo ;
https://ibm-pi-demo.mybluemix.net/
;
http://www.blablameter.com/index.php
;
SPEECH-TO-TEXT
https://www.ibm.com/demos/live/speech-to-text/self-service/home
;
https://cloud.google.com/speech-to-text
;
https://cloud.google.com/speech-to-text/?hl=en ;
SPEECH-TO-SPEECH
SPEECH-TO-SEMANTICS
https://aidemos.microsoft.com/luis/demo
;
IMAGE-TO-SEMANTICS
https://cloud.google.com/vision/ ;
https://www.clarifai.com/models/image-recognition-ai
(more: https://www.clarifai.com/computer-vision
);
https://face-api.sightcorp.com/demo-basic/
;
https://vision-explorer.allenai.org/detection
;
https://developer.opencv.fr/ui/#/onboard/demo
;
TEXT-TO-IMAGE
https://deepai.org/machine-learning-model/text2img
;
https://hotpot.ai/art-generator ;
https://creator.nightcafe.studio/ ;
https://catalog.ngc.nvidia.com/orgs/nvidia/teams/playground/models/sdxl ;
https://deepai.org/machine-learning-model/text2img ;
IMAGE-TO-IMAGE
https://deepai.org/machine-learning-model/image-editor ;
https://mxface.ai/face-comparing#abcd
;
https://www.artguru.ai/swap-face/#
https://demo.changemyface.com/ ;
https://age-and-lifestyle.changemyface.com/ ;
https://ailab.wondershare.com/tools/aging-filter.html
;
https://www.fotor.com/images/create ;
https://deepai.org/machine-learning-model/image-similarity
;
https://betaface.com/demo.html ;
https://reface.ai/unboring/face-swap ;
https://www.photoroom.com/tools/remove-object-from-photo ;
https://blackandwhite.imageonline.co/ ;
https://playback.fm/colorize-photo ;
https://palette.fm/color/filters ;
https://vanceai.com/old-photo-restoration ;
https://www.nvidia.com/research/inpainting/ ;
https://3dthis.com/3dface.htm ;
https://openai.com/blog/glow/ ;
https://deepai.org/machine-learning-model/colorizer
;
http://demos.algorithmia.com/colorize-photos/ ;
https://deepai.org/machine-learning-model/toonify
;
https://www.befunky.com/create/photo-to-cartoon/
;
https://deepai.org/machine-learning-model/torch-srgan
;
https://deepai.org/machine-learning-model/waifu2x
;
https://deepai.org/machine-learning-model/deepdream
;
https://deepdreamgenerator.com/ ;
https://deepai.org/machine-learning-model/fast-style-transfer
;
https://deepai.org/machine-learning-model/neural-style
;
http://cs.stanford.edu/people/karpathy/convnetjs/demo/image_regression.html
;
https://thispersondoesnotexist.com/ ;
https://looka.com/logo-maker/ ;
https://ai.cloudinary.com/demos/fill
IMAGE-TO-VIDEO
https://app.tokkingheads.com/homepage
;
https://www.myheritage.com/deep-nostalgia/ ;
https://sketch.metademolab.com/canvas
SPEECH-TO-VIDEO
https://seamless.metademolab.com/expressive/
IMAGE-TO-TEXT
https://milhidaka.github.io/chainer-image-caption/
;
https://jah.outsystemscloud.com/ImageToTextDEMO/
;
TEXT-TO-VIDEO
https://studio.d-id.com/?utm_content=photo2video
;
VIDEO-TO-TEXT
https://www.veed.io/tools/video-to-text
;
https://www.audiotype.org/en/transcribe/video/ ;
https://vi.microsoft.com/en-us ;
https://www.readtheirlips.com/
VIDEO-TO-AUDIO
https://audio-extractor.net/ .
VIDEO-TO-VIDEO
https://sam2.metademolab.com/demo
AUDIO-TO-AUDIO
https://audiobox.metademolab.com/storymaker/demo
ChatGPT and other chatbots and multiservice providers
https://chatgptonline.net/ [tutorial: https://metaroids.com/learn/what-is-chatgpt-beginners-guide-to-using-the-ai-chatbot/]
https://copilot.microsoft.com/
https://bing.com/ (chat)
https://portal.vision.cognitive.azure.com/gallery/featured
https://ai-service-demos.go-aws.com/
[useful tutorials: https://www.simplilearn.com/tutorials/chatgpt-tutorial/chatgpt-alternatives
]
and many-many other services/demos
online and their categories
-------------------------------------------
IMPORTANT
NOTICE!
Taking into account that companies, who are
providing these demos (listed above), often update their services or change
links to them, you are expected to use Google to find these (with broken links)
or similar services/demos online. It will be appreciated, if you will find for
your assignments interesting new demos (especially, new categories of revenant
demos) online, which are not listed above.
-------------------------------------------
Read more about AI-as-a-Service providers here:
https://encord.com/blog/ultimate-guide-ai-as-a-service/
https://redresscompliance.com/exploring-cloud-based-machine-learning-platforms/
Additional general and useful references:
- Online textbooks containing theories behind the cognitive computing
services:
Goodfellow, I., Bengio, Y., &
Courville, A. (2016). Deep Learning, MIT Press, 787 pp. (http://www.deeplearningbook.org)
Michael Nielsen (2017). Neural Networks and Deep
Learning.
(http://neuralnetworksanddeeplearning.com/)
Petersen, P., & Zech, J. (2024). Mathematical Theory of Deep Learning. arXiv
preprint arXiv:2407.18384. (https://arxiv.org/pdf/2407.18384
)
Sumithra, M. G., Dhanaraj, R. K., Iwendi, C., & Manoharan, A. M.
(Eds.). (2022). Deep Learning for Cognitive Computing Systems:
Technological Advancements and Applications (Vol. 7). Walter de
Gruyter GmbH & Co KG. (https://www.scribd.com/document/859454267/Deep-Learning-For-Cognitive-Computing-Systems-Technological-Advancements-And-Applications-Mg-Sumithra-pdf-download
)
https://www.ayadata.ai/top-10-books-on-machine-learning-and-ai/
https://digitaldefynd.com/IQ/top-books-for-learning-artificial-intelligence/