Toapi

A library letting any web site provide APIs.

Feature

Converting static html to api.
Serving as an api server.
Supporting both XPath selector and Regex.
Supporting custom request header.

Installaton

pip install toapi
pip install git+https://github.com/gaojiuli/toapi/

Usage

Static site:

from toapi import XPath, Item, Api

api = Api('https://news.ycombinator.com/')

class Post(Item):
    url = XPath('//a[@class="storylink"][1]/@href')
    title = XPath('//a[@class="storylink"][1]/text()')

    class Meta:
        source = XPath('//tr[@class="athing"]')
        route = '/'

api.register(Post)

print(api.parse('/'))

api.serve()

Site with ajax:

Phantomjs is required. Run phantomjs -v to check.
If you use Ubuntu. Run sudo apt install phantomjs to install.
If you use MacOS. Run brew install phantomjs to install.

from toapi import XPath, Item, Api

api = Api('https://news.ycombinator.com/', with_ajax=True) # This meas use selenium to load the page source.

class Post(Item):
    url = XPath('//a[@class="storylink"][1]/@href')
    title = XPath('//a[@class="storylink"][1]/text()')

    class Meta:
        source = XPath('//tr[@class="athing"]')
        route = '/'

api.register(Post)

print(api.parse('/'))

api.serve(ip='0.0.0.0',port='5000')

Visit: http://127.0.0.1:5000/

Then, You get your api server. Powered by flask.

Contribute

Open issue.
Pull Request.

License

Apache-2.0