ElasticSearch - Daily index mapping
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty{ margin-bottom:0;
}
Let's say i have an Index and I am want to create a daily index with an aliases.
Then I have some application that works against the elastic search(Mostly adding new documents to the index) and I am using Kibana to view and query against it.
So option number one for me is to have some separate Job which will run daily and create the index with its mapping and daily aliases. My problem here is that now my application is dependent on some outside job.
Option number two is before every insert to the ElasticSearch to check whether the Index exists(and if the mappings are current) and if not - to create it. Which seems to me worst then option 1 because of the overhead.
Any suggestions?
elasticsearch
asked Sep 18 '18 at 9:00
omriomri
234115
bumped to the homepage by Community♦ 11 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
Let's say i have an Index and I am want to create a daily index with an aliases.
Then I have some application that works against the elastic search(Mostly adding new documents to the index) and I am using Kibana to view and query against it.
So option number one for me is to have some separate Job which will run daily and create the index with its mapping and daily aliases. My problem here is that now my application is dependent on some outside job.
Option number two is before every insert to the ElasticSearch to check whether the Index exists(and if the mappings are current) and if not - to create it. Which seems to me worst then option 1 because of the overhead.
Any suggestions?
elasticsearch
asked Sep 18 '18 at 9:00
omriomri
234115
bumped to the homepage by Community♦ 11 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
Let's say i have an Index and I am want to create a daily index with an aliases.
Then I have some application that works against the elastic search(Mostly adding new documents to the index) and I am using Kibana to view and query against it.
So option number one for me is to have some separate Job which will run daily and create the index with its mapping and daily aliases. My problem here is that now my application is dependent on some outside job.
Option number two is before every insert to the ElasticSearch to check whether the Index exists(and if the mappings are current) and if not - to create it. Which seems to me worst then option 1 because of the overhead.
Any suggestions?
elasticsearch
asked Sep 18 '18 at 9:00
omriomri
234115
Let's say i have an Index and I am want to create a daily index with an aliases.
Then I have some application that works against the elastic search(Mostly adding new documents to the index) and I am using Kibana to view and query against it.
So option number one for me is to have some separate Job which will run daily and create the index with its mapping and daily aliases. My problem here is that now my application is dependent on some outside job.
Option number two is before every insert to the ElasticSearch to check whether the Index exists(and if the mappings are current) and if not - to create it. Which seems to me worst then option 1 because of the overhead.
Any suggestions?
elasticsearch
elasticsearch
asked Sep 18 '18 at 9:00
omriomri
234115
asked Sep 18 '18 at 9:00
omriomri
234115
asked Sep 18 '18 at 9:00
omriomri
234115
asked Sep 18 '18 at 9:00
omriomri
234115
asked Sep 18 '18 at 9:00
omriomri
234115
234115
bumped to the homepage by Community♦ 11 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
bumped to the homepage by Community♦ 11 mins ago
This question has answers that may be good or bad; the system has marked it active so that they can be reviewed.
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
You don't need to do anything special, as a new index will be created when you attempt to add a document to a non-existent index.
You may want to create an index template to ensure that the automatically created indices receive correct settings and mappings.
You will still need an outside scheduled process to delete indexes when their retention period expires.
answered Sep 18 '18 at 13:29
mustacciomustaccio
10.1k72239
but that's not a good approach in my view. For example the automated index created, added an "ignore_above" 256 chars as a default for every strting, what if i don't want that property. creating a template may be a good solution, i will look into that and update. thx!
– omri
Sep 20 '18 at 6:11
add a comment |
Your Answer
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "182"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdba.stackexchange.com%2fquestions%2f217885%2felasticsearch-daily-index-mapping%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
You don't need to do anything special, as a new index will be created when you attempt to add a document to a non-existent index.
You may want to create an index template to ensure that the automatically created indices receive correct settings and mappings.
You will still need an outside scheduled process to delete indexes when their retention period expires.
answered Sep 18 '18 at 13:29
mustacciomustaccio
10.1k72239
but that's not a good approach in my view. For example the automated index created, added an "ignore_above" 256 chars as a default for every strting, what if i don't want that property. creating a template may be a good solution, i will look into that and update. thx!
– omri
Sep 20 '18 at 6:11
add a comment |
You don't need to do anything special, as a new index will be created when you attempt to add a document to a non-existent index.
You may want to create an index template to ensure that the automatically created indices receive correct settings and mappings.
You will still need an outside scheduled process to delete indexes when their retention period expires.
answered Sep 18 '18 at 13:29
mustacciomustaccio
10.1k72239
but that's not a good approach in my view. For example the automated index created, added an "ignore_above" 256 chars as a default for every strting, what if i don't want that property. creating a template may be a good solution, i will look into that and update. thx!
– omri
Sep 20 '18 at 6:11
add a comment |
You don't need to do anything special, as a new index will be created when you attempt to add a document to a non-existent index.
You may want to create an index template to ensure that the automatically created indices receive correct settings and mappings.
You will still need an outside scheduled process to delete indexes when their retention period expires.
answered Sep 18 '18 at 13:29
mustacciomustaccio
10.1k72239
You don't need to do anything special, as a new index will be created when you attempt to add a document to a non-existent index.
You may want to create an index template to ensure that the automatically created indices receive correct settings and mappings.
You will still need an outside scheduled process to delete indexes when their retention period expires.
answered Sep 18 '18 at 13:29
mustacciomustaccio
10.1k72239
answered Sep 18 '18 at 13:29
mustacciomustaccio
10.1k72239
answered Sep 18 '18 at 13:29
mustacciomustaccio
10.1k72239
answered Sep 18 '18 at 13:29
mustacciomustaccio
10.1k72239
10.1k72239
but that's not a good approach in my view. For example the automated index created, added an "ignore_above" 256 chars as a default for every strting, what if i don't want that property. creating a template may be a good solution, i will look into that and update. thx!
– omri
Sep 20 '18 at 6:11
add a comment |
but that's not a good approach in my view. For example the automated index created, added an "ignore_above" 256 chars as a default for every strting, what if i don't want that property. creating a template may be a good solution, i will look into that and update. thx!
– omri
Sep 20 '18 at 6:11
but that's not a good approach in my view. For example the automated index created, added an "ignore_above" 256 chars as a default for every strting, what if i don't want that property. creating a template may be a good solution, i will look into that and update. thx!
– omri
Sep 20 '18 at 6:11
but that's not a good approach in my view. For example the automated index created, added an "ignore_above" 256 chars as a default for every strting, what if i don't want that property. creating a template may be a good solution, i will look into that and update. thx!
– omri
Sep 20 '18 at 6:11
add a comment |
Thanks for contributing an answer to Database Administrators Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fdba.stackexchange.com%2fquestions%2f217885%2felasticsearch-daily-index-mapping%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
