I am following Folland to study integration theory. It seems like we are restricted to consider only

Folland's version is standard for integrals defined by measure theory.

1. Define
${\int <!--\; \int \; -->}_{X}fd\mathrm{\mu <!--\; \mu \; -->}:={\int <!--\; \int \; -->}_X{f}^{+}d\mathrm{\mu <!--\; \mu \; -->}-<!--\; -\; -->{\int <!--\; \int \; -->}_X{f}^{-<!--\; -\; -->}d\mathrm{\mu <!--\; \mu \; -->}$
and declare $f$ integrable if both are finite.
2. If only one of those integrals is infinite, do not say that $f$ is integrable but write this anyway:
${\int <!--\; \int \; -->}_{X}fd\mathrm{\mu <!--\; \mu \; -->}:={\int <!--\; \int \; -->}_X{f}^{+}d\mathrm{\mu <!--\; \mu \; -->}-<!--\; -\; -->{\int <!--\; \int \; -->}_X{f}^{-<!--\; -\; -->}d\mathrm{\mu <!--\; \mu \; -->}$
allowing values $+\mathrm{\infty <!--\; \infty \; -->}$ and $-<!--\; -\; -->\mathrm{\infty <!--\; \infty \; -->}$.
3. If ${\int <!--\; \int \; -->}_X{f}^{+}d\mathrm{\mu <!--\; \mu \; -->}={\int <!--\; \int \; -->}_X{f}^{-<!--\; -\; -->}d\mathrm{\mu <!--\; \mu \; -->}=\mathrm{\infty <!--\; \infty \; -->}$ do not say anything and do not use the expression ${\int <!--\; \int \; -->}_{X}fd\mathrm{\mu <!--\; \mu \; -->}$ since (in measure theory) it cannot be assigned any meaningful value.

For purposes of exposition this allows a nice theory for integrable functions, and it allows many theorems for nonintegrable functions to be stated with infinite integrals. Most good theorems will be stated for integrable functions. With some caution you can still use the infinite valued integral, but be careful. It is not worth fussing too much, just don't be seduced into false statements.
In case #3 there is no theory? Well in many cases there is, but it is outside measure theory.
Restrict attention to the real line. Now this is Lebesgue's classical theory, except he originally called "integrable" functions "summable" probably so as not to conflict with Riemann integrability.
Is there any interest in functions $f:[a,b]\to <!--\; \to \; -->\mathbb{R}$ for which
${\int <!--\; \int \; -->}_a^b{f}^{+}(x)dx={\int <!--\; \int \; -->}_a^b{f}^{-<!--\; -\; -->}(x)dx=\mathrm{\infty <!--\; \infty \; -->}$
which is case #3 above (ignored by measure theory and by Lebesgue's original integral)?
The problem that Lebesgue gave as his motivation was to find an integral that handled all derivatives and included the Riemann integral. The Riemann integral does not integrate all derivatives.
Unfortunately neither does Lebesgue's integral. I gather this annoyed him. It handled all bounded derivatives and includes the Riemann integral.
But "most" derivatives are like this: $F^{\prime }(x)=f(x)$ for all $x\in <!--\; \in \; -->[a,b]$ but
${\int <!--\; \int \; -->}_a^b{f}^{+}(x)dx={\int <!--\; \int \; -->}_a^b{f}^{-<!--\; -\; -->}(x)dx=\mathrm{\infty <!--\; \infty \; -->}.$
So very sorry. Cannot integrate derivatives. But Newton and Leibnitz could (albeit trivially). Why isn't
${\int <!--\; \int \; -->}_a^{b}f(x)dx=F(b)-<!--\; -\; -->F(a)?$
Apologize. Sheepishly say, the Lebesgue integral wasn't designed for that. Or develop an entirely different method of integration that is not based on measure theory.
That was done about ten years after Lebesgue's integral by a German mathematician Perron and a French mathematician Denjoy. Their integral includes the Lebesgue integral and integrates all derivatives. So you might say their integration method explores the case #3 above that measure theory refuses to address.
The story continues. A trigonometric series can converge everywhere to a function that is not Lebesgue integrable (or even Denjoy-Perron integrable). Ideally you would want to compute the coefficients using the Fourier formulas---but what integral can you use? Time for another "nonabsolutely convergent integral" that lives in the same crack left by #3.
Want more? Probably not, but there are more.
The short answer is that the case #3 that measure theory and Lebesgue himself abandonned can be explored by other methods suitable to the situation. But measure theory is designed to leave that case alone. But the situations #1 and #2 cover most interesting and important applications anyway, so not a lot is lost.