GitXplorerGitXplorer
r

GSoC-Organisation-Scraper

public
125 stars
63 forks
13 issues

Commits

List of commits on branch master.
Verified
e4701ea6e3895416402418cfc5455e0b95f4d6a8

Add the support for python3 (#44)

ggeetesh-gupta committed 4 years ago
Verified
ba88fa5706c7b8738fa97e8a120fdd2d42101993

Updated resources by adding 2019 and 2020 organisations (#46)

ppriyanshuone6 committed 4 years ago
Verified
0888c009cc63f0f5bb68dc3e9905e2fda77766cc

Merge pull request #39 from shreyansh23/issue-38

rrohithasrk committed 6 years ago
Unverified
a5b174674ebbaa511bd9330220e5ab2e66dabff3

Add 2018.txt

sshreyansh23 committed 6 years ago
Unverified
a141bbd9bda37c568272b141d99df03133d207c9

Updated Readme to use Python 2.7 (#37)

AAnkk98 committed 6 years ago
Unverified
f6c5d166dde921de1184da97e2a2961045802fdb

Fix lint warnings

rrohithasrk committed 6 years ago

README

The README file for this repository.

GSoC Organisation Scraper

Makes life easier by scraping instead of searching for each and every organisation by name. Also shows number of times that an organisation has appeared in GSoC. Used Requests library of python and BeautifulSoup

Use Python-2.7

Requirements :

  • BeautifulSoup
  • Requests

Instructions :

# Clone this repository
git clone https://github.com/rohithasrk/GSoC-Organisation-Scraper.git

# Go into the repository
cd GSoC-Organisation-Scraper

# Install dependencies
[sudo] pip2 install -r requirements.txt

# Run the app without giving technology as a command line argument 
python2 scrape.py

# Enter the technology of preference when prompted.
# Example: python

# Run the app by giving technology as a command line argument 
python2 scrape.py javascript

#To store the output to a text file use pipe
python2 scrape.py ruby > ruby_orgs

Screenshots :

When browsed for javascript and ruby, some of the results are as shown below.

Python orgs 1

Python orgs 2

TODOs :

  • Make the code run faster.
  • Remove multiple results.

Contributing :

  • Fork the repo.
  • Create a new branch named <your_feature>
  • Commit changes and make a PR.
  • PRs are welcome.

This program uses PyTerm-Colors : https://github.com/vinamarora8/PyTerm-Colors.git