Google Search By Google Api In R Or Python

I want to search some thing (ex:'python language') in google by python or R and it will give me the list of links for that google search like: https://en.wikipedia.org/wiki/Python_

Solution 1:

Disclaimer: I work at SerpApi.

You can use the google-search-results package to extract links from Google Search.

Full example at Repl.it

import os
from serpapi import GoogleSearch

params = {
    "engine": "google",
    "q": "coffee",
    "api_key": os.getenv("API_KEY")
}

client = GoogleSearch(params)
data = client.get_dict()

print("Organic results\n")

for result in data['organic_results']:
  print(f"Link: {result['link']}")

Response

{"organic_results":[{"position":1,"title":"Coffee - Wikipedia","link":"https://en.wikipedia.org/wiki/Coffee","displayed_link":"en.wikipedia.org › wiki › Coffee","thumbnail":null,"snippet":"Coffee is a brewed drink prepared from roasted coffee beans, the seeds of berries from certain Coffea species.","sitelinks":{"inline":[{"title":"History of coffee","link":"https://en.wikipedia.org/wiki/History_of_coffee"},{"title":"Coffee bean","link":"https://en.wikipedia.org/wiki/Coffee_bean"},{"title":"Coffee production","link":"https://en.wikipedia.org/wiki/Coffee_production"},{"title":"Coffee preparation","link":"https://en.wikipedia.org/wiki/Coffee_preparation"}],"list":[{"date":"Color‎: ‎Black, dark brown, light brown, beige"}]},"rich_snippet":{"bottom":{"detected_extensions":{"introduced‎_‎th_century":15},"extensions":["Introduced‎: ‎15th century","Color‎: ‎Black, dark brown, light brown, beige"]}},"cached_page_link":"https://webcache.googleusercontent.com/search?q=cache:U6oJMnF-eeUJ:https://en.wikipedia.org/wiki/Coffee+&cd=4&hl=en&ct=clnk&gl=us","related_pages_link":"https://www.google.com/search?hl=en&gl=us&q=related:https://en.wikipedia.org/wiki/Coffee+Coffee&tbo=1&sa=X&ved=2ahUKEwjl7er0gLvoAhWRQN4KHRqmAQwQHzADegQIAhAH"},{"position":2,"title":"The House of Coffi - Coffee Shop - Dover, Delaware - 132 ...","link":"https://www.facebook.com/TheHouseOfCoffi/","displayed_link":"www.facebook.com › Places › Dover, Delaware › Restaurant","thumbnail":null,"snippet":"People talk about \"iced mocha coffee\", \"flavored iced tea\" and \"chai tea\". Relaxing atmosphere・Expert baristas・Convenient location. My first visit was a very ...","rich_snippet":{"top":{"detected_extensions":{"rating":5,"votes":132},"extensions":["Rating: 5","132 votes"]}}}// Stripped...]}

Output

Organic results

Link: https://en.wikipedia.org/wiki/Coffee
Link: https://www.amazon.com/coffee/s?k=coffee
Link: https://www.kansas.com/entertainment/restaurants/dining-with-denise-neil/article4383840.html
Link: https://www.reverieroasters.com/
Link: https://www.medicalnewstoday.com/articles/270202
Link: http://www.ncausa.org/about-coffee/what-is-coffee
Link: http://www.ncausa.org/about-coffee
Link: https://www.facebook.com/KookaburraCoffeeLyfe/

If you want more information, check out SerpApi documentation.

Solution 2:

I have used this python web search api to perform google search in python. Fairly straightforward to use and easy to install.