Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Take the RobotsTxt User-Agent from the Request #294

Merged
merged 10 commits into from
Apr 29, 2024
Merged

Take the RobotsTxt User-Agent from the Request #294

merged 10 commits into from
Apr 29, 2024

Commits on Apr 4, 2024

  1. Get the correct user agent from the request

    Andreas Donig committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    28f88ea View commit details
    Browse the repository at this point in the history

  2. Add debug logging to find out if it works as expected

    Andreas Donig committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    0c6d1bb View commit details
    Browse the repository at this point in the history

  3. Unpack the user-agent correctly

    Andreas Donig committed Apr 4, 2024
    Configuration menu
    Copy the full SHA
    5f89aaf View commit details
    Browse the repository at this point in the history

Commits on Apr 6, 2024

  1. Use the enhanced gollum fork

    Andreas Donig committed Apr 6, 2024
    Configuration menu
    Copy the full SHA
    aa1064c View commit details
    Browse the repository at this point in the history

  2. Handle a missing user-agent header

    Andreas Donig committed Apr 6, 2024
    Configuration menu
    Copy the full SHA
    a5ef370 View commit details
    Browse the repository at this point in the history

  3. Upgrade httppoison to 2.2

    Andreas Donig committed Apr 6, 2024
    Configuration menu
    Copy the full SHA
    8fe4c89 View commit details
    Browse the repository at this point in the history

Commits on Apr 9, 2024

  1. Add a helper function to get headers

    Andreas Donig committed Apr 9, 2024
    Configuration menu
    Copy the full SHA
    eb76cca View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2024

  1. Merge with origin/master

    Andreas Donig committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    859ad35 View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2024

  1. Merge branch 'master' into robotstxt-user-agent

    Andreas Donig committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    361c41d View commit details
    Browse the repository at this point in the history

  2. Add a test for the user-agent

    Andreas Donig committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    36bd832 View commit details
    Browse the repository at this point in the history