Aditya Chatterjee's Blog, page 47

Tokenization in NLP [Complete Guide]

In this article, we will look at the different approaches to tokenization and their pros and cons in Natural Language Processing (NLP).

Table of ContentWhat is TokenizationRule based TokenizationDictionary-Based TokenizationStatistical-Based TokenizationWhite Space TokenizationPenn Tree TokenizationMoses TokenizationSubword TokenizationByte-Pair EncodingWhat is Tokenization?

Tokenization is an essential part of natural language processing (NLP). It involves splitting a text into smal...

3 Types of Naive Bayes

In this article, we have explored the 3 different types of Naive Bayes classification algorithm in depth.

Naive Bayes is a classification algorithm based on Bayes' theorem. It is called "naive" because it assumes that the features are independent of each other, which may not be true in real-world scenarios. Despite this simplifying assumption, Naive Bayes is a popular choice for many classification problems due to its simplicity and high accuracy.

There are three main types of Naive Bayes classi...

Problems in Deep Learning (DL)

Today, we will be discussing the challenges faced by developers while working with deep learning models. Despite the impressive capabilities of deep learning models, there are various challenges that developers face while building and deploying them. If you are new to deep learning, learn Key Terms in Deep Learning.

We'll discuss:

IntroductionGeneral Problems in Deep LearningOverfittingUnderfittingData ImbalanceLimited DataAdversarial AttacksComputational CostAI Explainability/Black B...

Thundering Herd Problem

In this article, we will be learning about Thundering Herd Problem. This is one of the issue that occurs in Computer Systems during multi-threading.

Table Of Contents:

What is Thundering Herd Problem and it's Cause.It's effect on computer systemsCascading FailureHow to avoid Thundering Herd ProblemSyncchronisationUsing SemaphoreLeaky Bucket and Token Bucket AlgorithmsWhat is Thundering Herd Problem and it's casue.

When many processes from waiting or hault state suddenly comes to read...

Markov Chain in Neural Network

In this article, we have explored the concept of Markov chain along with their definition, applications, and operational details. We have covered how Markov Chain is used in the field of Deep Learning/ Neural Network.

Table of contents:

IntroductionBasic ConceptMarkov chain typesMarkov Chains PropertiesExampleApplications
6.1. Markov Chain applications in Neural NetworksMarkov chain neural networkConclusionIntroduction

Markov chains are mathematical structures that jump from one "state...

N-gram language model in NLP

Natural Language Processing (NLP) is a rapidly growing field in computer science that focuses on making computers understand human language. One of the key tools used in NLP is the N-gram language model.

In this article, we will explore what N-gram models are, how they work, their advantages and disadvantages, and finally, we'll provide an example of how to implement an N-gram model.

What is an N-gram model?

The N-gram model is a statistical language model that estimates the probability of the n...

Student Management System in Java

Introduction

Managing and organizing student data is an essential aspect of any educational institution.

As the number of students increases, it becomes increasingly difficult to keep track of their records manually.Therefore, a graphical user interface (GUI) for student database management can be a useful tool for schools, colleges, and universities.A student database GUI provides a user-friendly interface to store, retrieve, and manipulate student data efficiently.This system helps to aut...

Pneumonia Detection on Chest X-Rays with Deep Learning [DL Project]

In this article, we have developed a Deep Learning model to detect Pneumonia from Chest X-Rays and get a performance similar to a Radiologist. This is a good project for Deep Learning Engineer Portfolio.

We have summarized the key points from the paper titled "CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning".

1. Introduction:

Pneumonia is an dangerous and serious disease, in US only there are more than 1 million adult who hospitalized with pneumonia and around 5...

Sharding

Sharding is a technique used in database architecture to partition a large database into smaller, more manageable pieces called shards. Each shard contains a subset of the data in the larger database, and is stored on a separate server or cluster of servers. This article will explore the concept of sharding in more detail, and provide examples of how it is used in real-world applications.

What is Sharding?

Sharding is a method of horizontal partitioning in which large databases are divided into ...

How to check if same URL is open in another tab?

Introduction

In today's world, we tend to open multiple tabs while working or browsing the internet. Often we may accidentally open the same URL in multiple tabs, which can lead to confusion and slow down our browsing experience. Therefore, it is important to be able to detect whether the same URL is already open in another tab. In this article, we will explore how to check if the same URL is open in another tab.

Problem statement

The problem arises when we open multiple tabs and accidentally op...