Gensim not offering summarization anymore

[yungsinatra0]

Hi, thanks for this amazing content in this repo. I've tried implementing Gensim, but it seems that they have removed the summarization module. As such, the code in the Gensim notebook is not valid anymore :(

[Tuhin-SnapD]

Hey Calin,
https://colab.research.google.com/drive/1UcPO-S6eMPaPmNX1e5x0_Z61701sQ9I7?usp=sharing

Try accessing this notebook, I agree that Gensim have removed the summarisation module, but we can use the LDA model provided by them, and the usage of tokenizer and corpora goes without saying, Thank you for going through my repository tho <3

[Tuhin-SnapD]

Please note that this approach is a simplified example and might not always yield perfect results.

It combines topic modeling with sentence ranking to perform extractive summarization using Gensim. The quality of the summary will depend on factors like the choice of topics, the number of sentences selected, and the specific characteristics of the input text.

[yungsinatra0]

Hi @Tuhin-SnapD thanks for the reply! I've decided not to use Gensim as I believe there might be 'better' extractive summarization methods currently available for use. I wanted to ask you as well if you're aware of any cutting-edge or state-of-the-art models that do extractive summarization and whether you are familiar with using them?

[Tuhin-SnapD]

Hi @Tuhin-SnapD thanks for the reply! I've decided not to use Gensim as I believe there might be 'better' extractive summarization methods currently available for use. I wanted to ask you as well if you're aware of any cutting-edge or state-of-the-art models that do extractive summarization and whether you are familiar with using them?

Try Pegasus or transformer based models🤝