Edit Page

assets/robots.txt

Purpose

This file tells search engines and roving packs of robot spiders about whether or not the content in your app should be indexed.

You can read more about robots.txt here, or about how it is parsed by Google here.

# The robots.txt file is used to control how search engines index your live URLs.
# See http://sailsjs.com/documentation/anatomy/my-app/assets/robots-txt for more information.



# To prevent search engines from seeing the site altogether, uncomment the next two lines:
# User-Agent: *
# Disallow: /

Want to see for yourself?

An example of this file can be found in our sample app repo, here.

Sails logo
  • Home
  • Get started
  • Support
  • Documentation
  • Documentation

For a better experience on sailsjs.com, update your browser.

Documentation

Reference Concepts App structure | Upgrading Contribution guide | Tutorials More

App Structure


  • api
    • controllers
      • .gitkeep
      • UserController.js
    • hooks
      • myHook
        • index.js
    • models
      • .gitkeep
      • User.js
    • policies
      • sessionAuth.js
    • responses
      • badRequest.js
      • forbidden.js
      • notFound.js
      • ok.js
      • serverError.js
    • services
      • .gitkeep
  • assets
    • images
      • .gitkeep
    • js
      • dependencies
        • sails.io.js
    • styles
      • importer.less
    • templates
      • .gitkeep
    • favicon.ico
    • robots.txt
  • config
    • env
      • production.js
    • locales
      • de.json
      • en.json
      • es.json
      • fr.json
    • blueprints.js
    • bootstrap.js
    • connections.js
    • cors.js
    • csrf.js
    • globals.js
    • http.js
    • i18n.js
    • local.js
    • log.js
    • models.js
    • policies.js
    • routes.js
    • session.js
    • sockets.js
    • views.js
  • tasks
    • config
      • clean.js
      • coffee.js
      • concat.js
      • copy.js
      • cssmin.js
      • jst.js
      • less.js
      • sails-linker.js
      • sync.js
      • uglify.js
      • watch.js
    • register
      • build.js
      • buildProd.js
      • compileAssets.js
      • default.js
      • linkAssets.js
      • linkAssetsBuild.js
      • linkAssetsBuildProd.js
      • prod.js
      • syncAssets.js
    • pipeline.js
    • README.md
  • views
    • 403.ejs
    • 404.ejs
    • 500.ejs
    • homepage.ejs
    • layout.ejs
  • .gitignore
  • .sailsrc
  • app.js
  • Gruntfile.js
  • package.json
  • README.md

Built with Love

The Sails framework is maintained by a web & mobile studio in Austin, TX, with the help of our contributors. We created Sails in 2012 to assist us on Node.js projects. Naturally we open-sourced it. We hope it makes your life a little bit easier!

Sails:
  • What is Sails?
  • Treeline IDE
  • Contribute
  • Logos/artwork
About:
  • The Sails Company
  • Security
  • News
  • Legal
Help:
  • Get started
  • Documentation
  • Docs
  • Enterprise
  • Hire us

© 2012-2018 The Sails Company. 
The Sails framework is free and open-source under the MIT License.