Semantically Distinct Key Phrase Extraction

1 minute read

Working with Hilbert Space is fascinating. It is a hash function with prefix matching properties and two hashes can be compared just like a ZIP Code or a PIN Code. This implies that a vector in positive space can be hashed. Combining this with a typical vector transformation in NLP (say word2vec) can generate one dimensional embeddings.

To give an example, consider the words in months (april, july, january) and mathematics (mathematics, deep learning, machine learning). If we transform those words using a word vector embedding and do a hilbert hash, it would look like the following figure

Hilbert Hash for various words from word2vec )

What it implies are

  • If the topics are different, the hash prefix would differ
  • We can reduce all the words in an article to set of hashes and find most common prefixes they belong
  • The look up table can be saved as a dictionary for easy re-use. The original word vectors are no longer needed
  • A trie can do fast look up under each subtree and can summarize/rank keywords

Using this approach, the first thing we could do is to generate distinct key phrases from a given article text. The problem is caleed Key phrase extraction. The uniqueness of this approach is that generated key phrases will be semantically distnict.

Hashing Process )

Output from the package

Distinct Keywords Sample Output )

Generalization and benchmarks

The approach can be generalized to any vector embedding technique and can do semantic sentence comparison or document comparison in an unsupervised setting. The current implementation used Trie and SortedDict for making it one of the fastest implementation. The approach does not require any training and shown a 31% recall score while doing benchmark with KPTimes Test Data Set (20000 articles) with manual keywords Same preprocessing and comparison was done with KeyBert with top_n as 16 and compared.

KP Times Test Data Recall Score )

Supported languages

  1. English (default) using custom word2vec trained on simplewiki.
  2. German (on test. Need support from native speakers).
  3. French (on test. Need support from native speakers).
  4. Italian (on test. Need support from native speakers).
  5. Portuguese (on test. Need support from native speakers).
  6. Spanish (on test. Need support from native speakers).





It has the size of a normal protected envelope and it does not disclose its contents <a href=>tadalafil generic vs cialis</a> Cialis International Price Comparison Highlight


He only said to me on one single occasion, he said to me, that here they had prepared new buildings and that here he could put to death 10,000 daily <a href=>buy cialis online overnight shipping</a> Please allow up to 24 hours for your order to process, and an additional 2-3 days to be shipped out


Taking a drug like Levitra or Cialis may increase the risk of heart attack, stroke, or other heart problems in certain people <a href=>priligy india</a>


<a href=>generic cialis from india</a> 33 Six items of the IIEF pertain directly to erectile function and comprise the IIEF erectile function domain IIEF-EF or IIEF-6; score range 5 30


Let us examine macroscopic feature of cancer - tumor size, nodal status, and cancer survival - in terms of the underlying microscopic spread of cancer cells, occurring with a definable probability of spread per cell, <a href=>buy cialis online india</a> Can I take Viagra more than once per day


However, the thickness of the endometrium did not differ significantly between the two groups. <a href=>clomid twins</a> FertilAid For Men is a supplement manufactured by Fairhaven Health.


Following this presentation in late 2005, Novartis Pharmaceuticals, the Swiss company that developed letrozole for treatment of breast cancer, issued a warning to infertility clinics asserting that the company does not advocate the use of this medication for infertility treatment. <a href=>buying legal tamoxifin</a>


A fourth trial including patients with various types of CRAB infections randomized 94 patients to receive colistin alone or colistin with fosfomycin 105. <a href=>doxycycline dosage for uti how many days</a>


<a href=>meds similar to doxycycline</a> Participants assigned to dPEP will be instructed to take doxycycline 200 mg two 100mg capsules orally within 24 hours and up to 72 hours after each condomless sex act consistent with IPERGAY as frequently as daily if indicated but not more than once daily.


Estrogen receptor transcription and transactivation Estrogen receptor alpha and estrogen receptor beta regulation by selective estrogen receptor modulators and importance in breast cancer <a href=>lasix mechanism of action</a>


<a href=>furosemide lasix</a> For this analysis, we calculated two estimable quantities from our APC models net drift and the fitted age specific curves


<a href=>can you buy priligy over the counter</a> Nevertheless, performing mammography during the first 2 weeks of the menstrual cycle may increase mammographic accuracy, 111 probably because women do not feel as much discomfort during breast compression


The longer the cycle, the worse <a href=>how to take nolvadex for pct</a> com 20 E2 AD 90 20Diltiazem 20Interactions 20With 20Viagra 20 20Viagra 20Alternatives 20That 20Work viagra alternatives that work Since seizing power aided by the Seleka alliance, transitional President Michel Djotodia has failed to control the ex rebel fighters who have been accused of unleashing a wave violence on civilians despite being officially dissolved


As a rule, oral replacement can be used as soon as the patient is able and allowed to take orally <a href=>buy provera and clomid online</a> It is also common to have redness and pain and the injection site


Garcia A, Cayla X, Guergnon J <a href=>lasix loop diuretic</a> If any patient presents with VTE, Tamoxifen Farmos should be stopped immediately and appropriate anti thrombosis measures initiated

Leave a comment

Your email address will not be published. Required fields are marked *