Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-32539

Disallow FileSystem.get(Configuration conf) by default

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.1.0
    • 3.1.0
    • Project Infra
    • None

    Description

      The method `FileSystem.get(Configuration conf)` will return a default FileSystem instance if the conf is not set properly. This can cause regression if the target file system is not the default implementation.
      If we disallow it in Scala style check by default and suggest developers use FileSystem.get(URI uri, Configuration conf) or Path.getFileSystem(), we can reduce potential regression and PR review effort.

      Attachments

        Activity

          People

            Gengliang.Wang Gengliang Wang
            Gengliang.Wang Gengliang Wang
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: